Video security camera with two fields of view

ABSTRACT

An apparatus includes a first video capture device, a second video capture device and a circuit. The first video capture device may be configured to capture a first plurality of video frames of a first field of view. The second video capture device may be configured to capture a second plurality of video frames of a second field of view. The circuit may be configured to generate a first video stream in response to the first video frames, generate a second video stream in response to the second video frames and wirelessly communicate the first video stream and the second video stream to a device. The first field of view may capture an area in front of the apparatus. The second field of view may capture an area under and behind the apparatus. The second field of view may comprise a blind spot of the first field of view.

This application relates U.S. Ser. No. 16/111,669, filed Aug. 24, 2018,which relates to (i) U.S. Provisional Application No. 62/661,341, filedApr. 23, 2018 and (ii) U.S. Ser. No. 15/611,975, filed Jun. 2, 2017.This application also relates to U.S. Ser. No. 16/143,853, filed Sep.27, 2018. Each of the mentioned applications are hereby incorporated byreference in their entirety.

FIELD OF THE INVENTION

The invention relates to cameras generally and, more particularly, to amethod and/or apparatus for implementing a video security camera withtwo fields of view.

BACKGROUND

“Smart” home products that connect to home networks are increasing inpopularity. In particular, internet-connected security products canreduce home invasions. Conventional home security products capture videoof an area near a home or business. Despite the deterrent effects ofhome security products, package thefts are still common. Becauseconventional home security products do not provide a view of packagesleft at the door, packages can be taken after they are delivered butbefore the intended recipient can retrieve the package. Furthermore,homeowners cannot see if notices are left on the door, or if a door wasaccidentally left open. Additionally, homeowners cannot see how visitorsare interacting with the door (i.e., to see if the visitor is attemptingto open the door).

It would be desirable to implement a video security camera with twofields of view.

SUMMARY

The invention concerns an apparatus comprising a first video capturedevice, a second video capture device and a circuit. The first videocapture device may be configured to capture a first plurality of videoframes of a first field of view. The second video capture device may beconfigured to capture a second plurality of video frames of a secondfield of view. The circuit may be configured to generate a first videostream in response to the first video frames, generate a second videostream in response to the second video frames and wirelessly communicatethe first video stream and the second video stream to a user device. Theapparatus may be mounted to a vertical surface. The first field of viewmay capture an area in front of the apparatus. The second field of viewmay capture an area under and behind the apparatus. The second field ofview may comprise a blind spot of the first field of view. The secondfield of view may include the surface below a level of the apparatus.

BRIEF DESCRIPTION OF THE FIGURES

Embodiments of the invention will be apparent from the followingdetailed description and the appended claims and drawings in which:

FIG. 1 is a diagram illustrating a block diagram of an exampleembodiment of the invention;

FIG. 2 is a diagram illustrating a diagram of an example embodiment ofthe invention;

FIG. 3 is a diagram illustrating a user device streaming multiple videostreams;

FIG. 4 is a diagram illustrating receiving a power supply from a lightbulb adapter;

FIG. 5 is a diagram illustrating an example socket adapter;

FIG. 6 is a diagram illustrating an alternate embodiment of a socketadapter with a spring loaded contact;

FIG. 7 is a diagram illustrating an example embodiment of a socketadapter with a light bulb;

FIG. 8 is a diagram illustrating an alternate view of a socket adapterwith an inset port;

FIG. 9 is a diagram illustrating an example cloud-based security system;

FIG. 10 is a diagram illustrating a rear view of the internal componentsof an exemplary embodiment of the invention;

FIG. 11 is a diagram illustrating a wedge attachment to change a viewingangle of the capture devices;

FIG. 12 is a diagram illustrating a secure flexible mount;

FIG. 13 is a diagram illustrating a table-top docking station;

FIG. 14 is a diagram illustrating a TV docking station;

FIG. 15 is a diagram illustrating a perspective view of an exampleembodiment of the invention;

FIG. 16 is a diagram illustrating a front view of an example embodimentof the invention;

FIG. 17 is a diagram illustrating a rear view of an example embodimentof the invention;

FIG. 18 is a diagram illustrating an exploded view of an exampleembodiment of the invention;

FIG. 19 is a diagram illustrating a side view of an example embodimentof the invention;

FIG. 20 is a diagram illustrating a user device streaming multiple videostreams;

FIG. 21 is a diagram illustrating a wedge prism in front of a cameralens;

FIG. 22 is a diagram illustrating a partial wedge prism; and

FIG. 23 is a diagram illustrating a compound lens.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Embodiments of the present invention include providing a video securitycamera with two fields of view that may (i) provide a view in front of,behind and below a mounting point, (ii) communicate video data to a userdevices, (iii) enable users to see packages left at the door, (iv)enable users to see a door under a camera mount, (v) be connected to adoorbell power supply, (vi) enable remote communication with visitors,(vii) implement a high video quality camera and a low video qualitycamera, (viii) provide inexpensive home security features and/or (ix) beimplemented as one or more integrated circuits.

Referring to FIG. 1, a block diagram illustrating an example embodimentof the invention is shown. An apparatus (or block, or circuit, or device100) is shown. The apparatus 100 may comprise blocks (or circuits) 102a-102 b and/or a block (or circuit) 104. The circuits 102 a-102 b mayimplement capture devices (e.g., video and/or image capture devices).The circuit 104 may be a circuit board comprising numerous componentsthat offer various functionality. The circuit 104 may comprise a block(or circuit) 106 and/or a block (or circuit) 108. The circuit 106 mayimplement a video processor. The circuit 108 may implement a wirelesscommunication device. The circuit 104 may comprise other components (notshown). The number, type and/or arrangement of the components of theapparatus 100 and/or the circuit 104 may be varied according to thedesign criteria of a particular implementation.

The capture device 102 a may be configured to capture one or more videoframes 110 a-110 n. In the example shown, lines 114 a-114 b mayrepresent a boundary and/or range of a field of view. The video frames110 a-110 n may comprise video and/or image frames of the field of view114 a-114 b. The capture device 102 b may be configured to capture oneor more video frames 112 a-112 n. In the example shown, lines 116 a-116b may represent a boundary and/or range of a field of view. The videoframes 112 a-112 n may comprise video and/or image frames of the fieldof view 116 a-116 b.

An area 118 a is shown between the lines 114 a-114 b. The area 118 a mayrepresent an area (e.g., an environment) within the field of view 114a-114 b captured by the capture device 102 a. In one example, the area118 a may be an area located in front of the apparatus 100. An area 118b is shown between the lines 116 a-116 b. The area 118 b may representan area (e.g., an environment) within the field of view 116 a-116 bcaptured by the capture device 102 b. In one example, the area 118 b maybe an area located under and/or behind the apparatus 100. In someembodiments, the area 118 a of the field of view 114 a-114 b maypartially overlap the area 118 b of the field of view 116 a-116 b (e.g.,the capture devices 102 a-102 b may each implement a wide angle lens).However, the area 118 b of the field of view 116 a-116 b may comprise ablind spot of the area 118 a of the field of view 114 a-114 b. Forexample, the blind spot of the capture device 102 a may be an area thatis not captured within the field of view 114 a-114 b.

The capture device 102 a may present the video frames 110 a-110 n to thecircuit 104. The capture device 102 b may present the video frames 112a-112 n to the circuit 104. The circuit 104 may generate a video stream(e.g., VS1) in response to the video frames 110 a-110 n. The circuit 104may generate a video stream (e.g., VS2) in response to the video frames112 a-112 n. In one example, the video processor 106 may be configuredto perform video operations on the video frames 110 a-110 n and/or thevideo frames 112 a-112 n to generate video data (e.g., the video streamVS1 and/or the video stream VS2). The video operations performed by thecircuit 104 and/or the video processor 106 may be varied according tothe design criteria of a particular implementation.

A block (or circuit) 120 is shown. The circuit 120 may be a circuitseparate from the apparatus 100. For example, the circuit 120 may nothave a wired connection to the apparatus 100. In some embodiments, thecircuit 120 may be separated from the apparatus 100 by long distances(e.g., miles). The circuit 120 may be a computing device (or userdevice). In the example shown, the computing device 120 may be asmartphone (e.g., a handheld or portable user device). In someembodiments, the computing device 120 may be implemented as a desktopcomputer, a laptop computer, a smart watch, a tablet computing device,etc. Generally, the computing device 120 may be a device configured tocommunicate wirelessly, display video content and/or receive/transmitaudio. The type of device implemented as the computing device 120 may bevaried according to the design criteria of a particular implementation.

The circuit 104 may wirelessly communicate the video stream VS1 and/orthe video stream VS2 to the smartphone 120. In an example, thecommunication device 108 may be configured to format the video streamsVS1 and/or VS2 to be communicated and/or establish a wirelesscommunication link between the circuit 104 and the smartphone 120 (e.g.,using Wi-Fi, cellular communication such as 3G/4G/LTE/5G, Bluetooth,etc.). In the example shown, the video stream VS1 and VS2 are shownbeing transmitted wirelessly to the smartphone 120. However, other datamay be transmitted between the smartphone 120 and the circuit 104 (e.g.,instructions and/or commands may be sent from the smartphone 120 to thecircuit 104, audio for implementing a two-way intercom may betransmitted, information about objects detected by video analysisperformed on the video frames 110 a-110 n and/or the video frames 112a-112 n may be transmitted by the circuit 104 to the smartphone 120,etc.). The type of information communicated, and/or the wirelesscommunication protocol(s) implemented may be varied according to thedesign criteria of a particular implementation.

Referring to FIG. 2, a diagram illustrating an example embodiment 50 ofthe apparatus 100 is shown. In the example embodiment 50, the apparatus100 is shown mounted to a surface 52 (e.g., a vertical surface, such asa wall, or a surface that is generally vertically oriented). Forexample, the apparatus 100 may be mounted to a wall of a premises. Forexample, the apparatus 100 may be mounted to the wall 52 near (e.g.,next to, above, beside, etc.) a door. Generally the apparatus 100 may bemounted to a vertical surface. The wall 52 may have a recessed section54. A dotted line 56 is shown. The dotted line 56 may represent a planeof the wall 52. The recessed section 54 may have an area behind theplane 56 of the wall 52. In the example shown, the apparatus 100 isshown mounted to the wall 52 above the recessed section 54.

The apparatus 100 may comprise a housing to contain the capture devices102 a-102 b and/or the circuit 104 (e.g., the video processor 106, thewireless communication device 108, other components, etc.). A lens 130 aand a lens 130 b are shown attached to (or sticking out from) thehousing of the apparatus 100. The lens 130 a may be a component of thecapture device 102 a. The lens 130 b may be a component of the capturedevice 102 b. In an example, the lenses 130 a-130 b may each implement awide angle lens.

The lens 130 a is shown on a front of the apparatus 100 (e.g., facingaway from the wall 52). The lens 130 a on the front of the apparatus 100may capture the field of view 114 a-114 b. For example, the field ofview 114 a-114 b is shown capturing the area 118 a in front of theapparatus 100 (e.g., to capture guests approaching a premises). The lens130 b is shown on a bottom side of the apparatus 100. The lens 130 b onthe bottom of the apparatus may capture the field of view 116 a-116 b.For example, the field of view 116 a-116 b captured by the bottom lens130 b may capture the area 118 b below and behind the apparatus 100(e.g., behind the plane 56 corresponding to the mounting surface 52 forthe apparatus 100). In the example shown, the field of view boundary 116b is shown extending into the recessed section 54 below and behind theapparatus 100. The wide angle of the lens 130 b may enable the capturedevice 102 b to capture the video frames 112 a-112 n of the area 118 bthat may be behind the mounting surface 52 of the apparatus 100.

An area 132 is shown. The area 132 may be an overlapping area of thearea 118 a captured by the capture device 102 a and the area 118 bcaptured by the capture device 102 b. For example, the capture devices102 a-102 b may both capture the overlapping area 132. In the exampleshown, the overlapping area 132 may be bounded by the field of view line114 b corresponding to the lens 130 a of the capture device 102 a andthe field of view line 116 a corresponding to the lens 130 b of thecapture device 102 b. An area beyond overlapping area 132 (e.g., outsideof the area 118 a and beyond the line 114 b) may be a blind spot of thefirst field of view 114 a-114 b of the capture device 102 a. The secondfield of view 116 a-116 b may capture the area 118 b that comprises theblind spot of the first field of view 114 a-114 b.

The housing of the apparatus 100 is shown having a speaker grille 134.The speaker grille 134 may enable audio to be emitted by an internalspeaker of the apparatus 100. For example, the internal speaker may beone of the components of the circuit 104. The speaker grille 134 mayenable audio to be received by an internal microphone. For example, theinternal microphone may be one of the components of the circuit 104. Thespeaker and microphone may enable the apparatus 100 to implement atwo-way audio communication (e.g., an intercom).

The apparatus 100 may comprise a button 136. The button 136 may enable avisitor to interact with the apparatus 100. In an example, the button136 may activate an audio alert within a premises (e.g., a doorbell).The button 136 may also activate and/or enable other functionality ofthe apparatus 100 (e.g., the intercom feature, a visitor identificationfeature, a configuration feature, etc.).

In some embodiments, the apparatus 100 may be mounted above a doorwayand/or access point of the premises (e.g., above a garage door, above awindow, above a front door, etc.). In the example shown, an offsetportion (e.g., the recessed section 54) of the wall 52 is shown belowthe apparatus 100 (e.g., a cutout for a door). The field of view 116a-116 b of the bottom lens 130 b is shown extending behind the apparatus100 and capturing the offset area 54 of the premises. The field of view116 a-116 b of the bottom lens 130 b may enable capturing (e.g.,streaming and/or recording) of the area below and behind the apparatus100. For example, the bottom lens 130 b may capture packages left infront of the door. The bottom lens 130 b may capture the door and/orwindow. In an example, the bottom lens 130 b may provide a view that mayshow notices attached to the front door and/or a view that shows whetherthe door is open or closed.

Referring to FIG. 3, a diagram illustrating the user device 120streaming multiple video streams is shown. An example context 60 of theinvention is shown. In the example context 60, the user device 120 isshown held by a user 62. For example, the user device 120 may be aportable (e.g., handheld) device. In the example shown, the user device120 may be a smartphone.

The smartphone 120 is shown having a display 150, a speaker 152 and amicrophone 154. In an example, the display 150 may be a touchscreendisplay enabling the user 62 to view output from the smartphone 120and/or provide input (e.g., touch controls) to the smartphone 120. Thespeaker 152 may playback audio. The microphone 154 may receive audio. Inan example, the speaker 152 and the microphone 154 may enable the user62 to interact with the apparatus 100 as a two-way intercom. In oneexample, the speaker 152 on the smartphone 120 may playback audiocaptured and wirelessly transmitted by the apparatus 100 (e.g., amicrophone component of the circuit 104). In another example, themicrophone 154 on the smartphone 120 may capture audio that may bewirelessly transmitted to the apparatus 100 and the apparatus 100 mayplayback the audio (e.g., using a speaker component of the circuit 104).

The display 150 is shown displaying a companion application 160. Theapparatus 100 may be compatible with the companion application 160. Forexample, the companion application 160 may be a smartphone app (e.g.,iOS app, an Android app). In some embodiments, the companion application160 may be a computer program (e.g., for Windows, macOS, Linux, etc.).The companion application 160 may enable the user 62 to remotelyinteract with the features of the apparatus 100. For example, thecompanion application 160 may be configured to interface with thesmartphone microphone 154 and speaker 152 to enable the user 62 to usethe apparatus 100 as an intercom (e.g., audio received by the smartphone120 may be played by the speaker of the apparatus 100 and audio receivedby the microphone of the apparatus 100 may be played back to the user bythe smartphone speaker 154).

In the example shown, the companion application 160 shown on thesmartphone 120 may display a video stream 162 a and a video stream 162b. The video stream 162 a may correspond with the video stream VS1generated by the apparatus 100. The video stream 162 b may correspondwith the video stream VS2 generated by the apparatus 100. For example,the apparatus 100 may be configured to wirelessly communicate (e.g., alive stream and/or a recorded file for later playback) the video streamsVS1-VS2 to the smartphone 120 using the communication device 108. Thecompanion application 160 may playback the video streams VS1-VS2 as thevideo streams 162 a-162 b.

In the example shown, the companion application 160 may further comprisecontrols 164 a-164 f. The controls 164 a-164 f may enable access tovarious features of the companion application 160. In one example, thecontrol 164 a may be a play/pause video progress bar (e.g., used tocontrol what portion of the video streams 162 a-162 b the user 62 isviewing). In another example, the control 164 b may be a live viewindicator (e.g., to indicate whether the video streams 162 a-162 b arelive video currently captured by the apparatus 100 or a pre-recordedfile). In yet another example, the control 164 c may be a toggle buttonto toggle between options (e.g., enable/disable a live view). In anotherexample, the control 164 d may be a button configured toactivate/deactivate audio communication (e.g., one-way audio by the user62 to be played back by the apparatus 100 and/or a two-way intercom toadditionally receive audio from the apparatus 100). In still anotherexample, the control 164 e may be a button to access other features ofthe smartphone 120 (e.g., an app-drawer). In another example, thecontrol 164 f may be a button configured to control a light that may becoupled with the apparatus 100. The features and/or controls 164 a-164 fimplemented by the companion application 160 may be varied according tothe design criteria of a particular implementation.

In the example shown, the companion application 160 operating on thesmartphone 120 may show a dual view displaying both video streams 162a-162 b. In some embodiments, the companion application 160 may displayone of the video streams 162 a-162 b at a time or neither of the videostreams 162 a-162 b. The dual view may comprise the front view videostream 162 a corresponding to the field of view 114 a-114 b captured bythe front facing lens 130 a. The dual view may comprise a bottom viewvideo stream 162 b corresponding to the field of view 116 a-116 bcaptured by the bottom lens 160 b.

In the example shown, a visitor 170 and an object (e.g., a vehicle) 172are shown in the video stream 162 a captured by the front capture device102 a. The video stream 162 a may be a view of the area 118 a in frontof the apparatus 100. For example, the apparatus 100 may be located atapproximately a head height of the visitor 170. In the example shown, atop down view of the visitor 170 is shown in the video stream 162 bcaptured by the bottom capture device 102 b. In an example, the lenses130 a-130 b may be implemented using a wide angle and/or fisheye lensproviding a 270 degree field of view. For example, some warping may bepresent on the bottom view video stream 162 b.

The bottom view video stream 162 b may be a view of the area 118 b belowand/or behind the apparatus 100. The bottom view video stream 162 b mayprovide a view of the door 174 below a level of the apparatus 100. Anotice 176 is shown on the door 174. A package 180 is shown in front ofthe door 174. The notice 176 and/or the package 180 may not be visiblewithout the field of view 116 a-116 b provided by the bottom capturedevice 102 b. The bottom view video stream 162 b may provide a view ofthe visitor 170 knocking on the door and/or trying to gain entry (e.g.,trying the doorknob).

In an example, the video streams 162 a-162 b may be played backsimultaneously. For example, the front view video stream 162 a may showa view of the face of the visitor 170 and the bottom view 162 b may showthe top down view of the visitor 170 at the same time. For example, ifthe visitor 170 is a burglar stealing the package 180, the front viewvideo 162 a may provide a clear view of the face (e.g., identity) of thevisitor 170 but not the package 180 and the bottom view video 162 b mayshow the visitor 170 stealing the package 180 but not provide a view ofthe face to identify the thief. Similarly, if the visitor 170 isattempting to break into the home by opening the door 174, the frontview video 162 a may not provide the view of the door 174 but the bottomview video 162 b may show the visitor 170 attempting to open the door.The videos 162 a-162 b captured by both the front capture device 102 aand the bottom capture device 102 b may be used as evidence for policeof the visitor 170 trying to steal the package 180 and/or attempting tobreak into the premises.

Referring to FIG. 4, a diagram illustrating the apparatus 100 receivinga power supply from a light bulb adapter is shown. In some embodiments,the apparatus 100 may be battery powered. In some embodiments, theapparatus 100 may be powered using a connection to doorbell wiring(e.g., a power supplied from the premises). In some embodiments, theapparatus 100 may receive power via a DC connection (e.g., a USBconnection). In an example, the apparatus 100 may receive power from alight bulb socket adapter configured to provide DC power using a poweradapter to convert AC power to DC.

An example context 200 is shown. In the example context 200, theapparatus 100 may implement a smart doorbell. The smart doorbell 100 maybe mounted to a wall. A front view of the apparatus 100 is shown. Thelens 130 a is shown on the front of the apparatus 100 and the lens 130 bis shown on a bottom side of the apparatus 100. The button 136 is shownbelow the lens 130 a on the front of the apparatus 100.

In some embodiments, the button 136 on the apparatus 100 may comprise afingerprint detector 202. A fingerprint of the visitor 170 may becaptured by the fingerprint detector (or scanner) 202 when the visitor170 presses the button 136 to activate the doorbell 100. The fingerprintscanner 202 may provide pre-screening and/or identification of thevisitor 170. For example, known visitors (e.g., friends, family,repeated guests, etc.) may be identified based on the fingerprint of thevisitor 170. The companion application may 160 enable customizedresponses based on visitor profiles. The visitor profile may comprisethe fingerprint to associate the detected visitor with the visitorprofile. In some embodiments, the fingerprint scans used to associatethe fingerprint detected by the fingerprint scanner 202 may be stored onthe apparatus 100 (e.g., by a memory component of the circuit 104). Insome embodiments, the fingerprints detected by the fingerprint scanner202 may be communicated wirelessly to a remote device (e.g., a cloudcomputing service, a database, a computer, etc.) to determine theidentity of the visitor 170 and provide the information in the visitorprofile.

When the visitor 170 is detected using the fingerprint scanner 202 (orusing other detection methods such as video analysis to perform facialrecognition by the video processor 106), one type of notification may bepresented to the user device 120 if the visitor 170 is identified withinthe visitor profile database. In some embodiments, emergency servicesmay provide databases of known criminals and/or other people of interest(e.g., missing persons, suspects, etc.).

In the example context 200, the apparatus 100 is shown connected to acable 204. The cable 204 may have a connector 206 a at one end toconnect to the apparatus 100. The cable 204 may have a connector 206 bto connect to another device. The cable 204 may be configured totransmit data and/or power. In an example, the cable 204 may be a USBtype cable. The type of cable implemented may be varied according to thedesign criteria of a particular implementation.

In the example context 200, the cable 204 may connect a smart light 210.The smart light 210 may comprise a lamp shade (or light sconce) 212and/or a universal base 214. A light bulb 216 may be within the lampshade 212. The cable connector 206 b may connect to a port 218 of thelight bulb 216. In the example shown, the light bulb 216 may comprise abase implementing a power adapter 220 and the port 218. In someembodiments, the light bulb may connect to a universal base implementingthe power adapter 220 and the port 218. In an example, the light bulb216 may be controlled by the companion application 160 using the control164 f (e.g., a signal to control the light bulb 216 may be transmittedfrom the apparatus 100 to the light bulb 216 via the cable 204).

In some embodiments, the power adapter 220 may be configured to receivean AC power supply (e.g., from a power source of the premises). Forexample, the power adapter 220 may provide the AC power to the lightbulb 216. The power adapter 220 may further be configured to generate aDC power supply from the AC power. In one example, the DC powergenerated by the power adapter 220 may be used to provide DC power tothe apparatus 100 via the cable 204. For example, the light bulb 216 maybe located within a range of the length of the cable 204 (e.g.,approximately 20 feet) to provide the power supply from the port 218.

In the example shown, the base 214 may comprise a faceplate 222 and/or aseal 224. The faceplate 222 may be used to cover an electrical junctionbox that may be a source of the AC power supply. In the example shown,the base 214 and/or the apparatus 100 may be located below the lightsconce 212. The apparatus 100 may be located anywhere within the lengthof the cable 204 to provide flexibility of placement of the apparatus100. In an example, the apparatus 100 may be located above, below,and/or to either side of the light fixture 210 and/or the lamp shade212. In another example, the location of the apparatus 100 may beselected to provide a desired (e.g., optimal) viewing angle and/or fieldof view for the lenses 130 a-130 b. In yet another example, the locationof the apparatus 100 may be placed in an obscure location (e.g., closeto a roof overhang and/or an eaves trough). In the example of theapparatus 100 implementing a doorbell, the apparatus 100 may be locatedat approximately chest or waist height (e.g., standard doorbell height).The location of the apparatus 100 may be varied according to the designcriteria of a particular implementation.

In the example shown, the cable 204 is visible for illustrativepurposes. However, when installed on the premises, the cable 204 may behidden and/or protected. In one example, an armored tube and/or aweatherproofed tube may be implemented to house the cable 204.Implementing the weatherproofed tube may protect the cable 204 fromphysical damage, prevent water from reaching the cable 204 and/or meetlocal electrical standards.

Referring to FIG. 5, a smart socket adapter 250 is shown having thepower adapter 220′. In some embodiments, the smart socket adapter 250may be implemented in the light fixture shown in association with FIG.4. Implementing the smart socket adapter 250 may provide the DC power tothe apparatus 100 via the port 218′ for the cable 204 using the poweradapter 220′ while using a standard light bulb in the light fixture 210.

The smart socket 250 may comprise a connector 254. The connector 254 maybe implemented as a screw-in base. The connector 254 may have similarimplementation as a screw-in base for standard light bulbs. Theconnector 254 may receive an AC power supply from, an electricalconnection to the light fixture 210. In one example, the connector 254may be a connector for an E26 socket. The size of the screw-in-base 254may be varied according to the criteria of a particular implementation.For example, the connector 254 may be a male connector for a femalereceptacle in the light fixture 210.

The smart socket 250 may comprise an adapter connector 252. The adapterconnector 252 may be implemented as a screw-in socket adapter. Thesocket adapter 252 may have a similar implementation as a screw-in basefor standard light bulbs. The adapter connector 252 may pass through theAC power supply to a standard light bulb. For example, the adapterconnector 252 may implement an E26 socket. The size of the screw-in-baseadapter 252 may be varied according to the criteria of a particularimplementation. For example, the adapter connector 252 may be a femalesocket for a male connector of the standard light bulb.

Another alternate location for the power adapter 220′ is in the lightbulb socket 250. Implementing the power adapter 220′ in the smart socketadapter 250 may avoid a need for wiring high voltage AC wires and/orconnecting doorbell wiring from the premises for the apparatus 100(e.g., enable the apparatus 100 to be installed at a location other thanthe pre-determined doorbell location for a home).

The connector 254 may use an electrical connection to receive the ACpower supply from the light fixture 210, similar to a standard lightbulb implementation. The smart socket adapter 250 may pass the AC powersupply received by the connector 254 through to the adapter connector252. The adapter connector 252 may provide the AC power supply to thestandard light bulb. The power adapter 220′ may convert the AC powersupply to a low voltage (e.g., DC) power supply. The power adapter 220′may present the low voltage power supply to the port 218′.

Referring to FIG. 6, an alternate embodiment of the smart socket adapter250′ is shown. In some embodiments, the smart socket adapter 250′ maycomprise a module 256. The module 256 may be a wireless communicationsmodule (e.g., implementing communication protocols for Wi-Fi, Bluetooth,ZigBee, etc.). In an example, the communication module 256 may beconfigured to implement a wireless connection to receive control signalsfrom the apparatus 100 (e.g., transmitted by the wireless communicationsmodule 108). The control signals may be configured to control the lightbulb (e.g., turn the light bulb on/off, control an intensity of thelight bulb, adjust a color of the light bulb, adjust a frequency of thelight bulb, etc.). In another example, the communication module 256 maybe configured to send data to the wireless communications module 108 ofthe apparatus 100 (e.g., to provide a status of the light bulb 80 suchas whether the light is on or off).

In some embodiments, the communication module 256 may be implemented forthe smart socket adapter 250′ instead of the port 218′. In someembodiments, the communication module 256 may be implemented in additionto the port 218′ (e.g., the port 218′ may be implemented to provide a DCpower supply and the communication module 256 may be used for thecommunication of the control signals with the apparatus 100). Thecommunication protocol(s) implemented by and/or the type of datatransmitted using the communication module 256 may be varied accordingto the design criteria of a particular implementation.

The smart socket adapter 250′ may be implemented with a spring loadedcontact 258. Generally, light fixtures are designed to have the lightbulb centered with respect to the lamp shade 210. The socket adapter250′ may be configured to limit an amount of extra height (e.g., aheight of 12 mm) caused by installing the socket adapter 250′. Thespring loaded contact 258 may be implemented on the connector 254′. Thespring loaded contact 258 may be implemented to allow the smart socketadapter 250′ to orient the port 218′ at any angle and maintain aconnection to the cable 204.

Referring to FIG. 7, an example embodiment of the socket adapter 84 isshown connected to a standard light bulb 80. The connector 206 b (e.g.,a USB cable) is shown plugged into the port 218. The light bulb 80 isshown connected to the adapter connector 252. In one example, the lightbulb 80 may be implemented as an incandescent light bulb. In anotherexample, the light bulb 80 may be implemented as a LED light bulb.

Connecting the light bulb 80 to the smart socket adapter 250 mayincrease an amount of space occupied by the light bulb 80. For example,the height of the smart socket adapter 250 may be added to the height ofthe light bulb 80. The height of the smart socket adapter 250 may beconstrained to a size of the male connector of the light bulb 80.

Referring to FIG. 8, an alternate view of the socket adapter 250 with aninset port is shown. The port 218′ is shown partially inset on the smartsocket adapter 250. Arranging the port 218′ to be inset may allow theconnector 206 to connect relatively flat against a side of the socketadapter 250 (e.g., prevent the connector 206 b from sticking out). Thealternate view shows the female socket on an inner portion of adapterconnector 252. In one example, the inner portion of the adapterconnector 252 may be threaded to accept the threading of the maleconnector of the light bulb 80. In another example, the inner portion ofthe adapter connector 252 may be a cavity for accepting male prongconnectors of the light bulb 80. The type of adapter connector 252implemented may be varied according to the design criteria of aparticular implementation.

Referring to FIG. 9, a diagram illustrating an example cloud-basedsecurity system 300 is shown. The system 300 generally comprises blocks302 a-302 n. The blocks 302 a-302 n may be homes and/or businesspremises. Each of the homes 302 a-302 n may comprise blocks 304 a-304 n.The blocks 304 a-304 n may be areas of interest (e.g., access points tothe homes and/or business premises 302 a-302 n). The smart cameras(e.g., doorbells) 100 a-100 n may be set up at each of the areas ofinterest 304 a-304 n of the homes and/or business premises 302 a-302 n.For example, the smart cameras 100 a-100 n may be configured to monitorthe areas of interest 304 a-304 n.

The system 300 may further comprise the internet and/or cloud service310, a receptionist 312, authorities 314, a web interface 316, adatabase 318 and/or the smartphones 120 a-120 n. In one example, thereceptionist 312 may be a virtual receptionist. In another example, thereceptionist 312 may be a person from a central monitoring service. Inone example, the authorities 314 may be the police department, the firedepartment, an ambulance, and/or other emergency services.

The areas of interest 304 a-304 n may be doors, windows, garages, otherentrances, and/or vantage points. Generally, the smart cameras 100 a-100n may be mounted at the areas of interest 304 a-304 n. Data from thesmart cameras 100 a-100 n at the homes and/or business premises 302a-302 n may be sent to the Internet and/or cloud service 310.

Data sent to the internet and/or cloud service 310 may be sent to theuser devices 120 a-120 n. For example, an alert from one of the smartcameras 100 a-100 n from the home 302 a may be sent to the device 120 aof the homeowner indicating that another family member has arrived home.In another example, an alert from one of the smart cameras 100 a-100 nfrom the home 302 n may be sent to the smartphone 120 c of an owner ofanother home (e.g., the owner of the home 302 b) that a suspiciousperson has been identified in the neighborhood. A user may then send anotification to the authorities 314. In yet another example, the device120 a may receive an alert from one of the smart cameras 100 a-100 nindicating that the package 180 has been delivered. A user of the userdevices 120 a-120 n may send data back to the smart cameras 100 a-100 nof the homes and/or business premises 302 a-302 n through the internetand/or cloud service 310. In one example, the homeowner 62 may send acommand to arm an alarm (e.g., one of the security responses) at theirhome.

In one example, the user devices 120 a-120 n may be in the possession oftrusted volunteers. The trusted volunteers may be other home owners inthe system 300. The trusted volunteers may be the first line of responseto a security issue detected by the system 300. Alerts by the system 300may be sent in parallel to all the trusted volunteers. The trustedvolunteers may use available communication channels provided such ascell phones, telephone and/or emails. The homeowner may adviseparticular pre-defined responses to particular alerts such as callingthe authorities 314 (e.g., the police and/or the fire department). Thetrusted volunteers may be able to activate a set of pre-defined actionsusing the user devices 120 a-120 n. The trusted volunteers may taketraining sessions to learn how to properly respond to various alerts.The training sessions may be taken on-line. The on-line trainingsessions may be available on the web interface 316 and/or using thecompanion application 160. For example, the web interface 316 may beused to access the companion application 160 via a desktop computerand/or smart TV.

If the network of trusted neighbors 302 a-302 n has the same system,they may exchange images, video, and/or other information of unwelcomedvisitors. The website and/or web interface 316 may have the database 318to manage the images, video, and/or other information. Unwelcomevisitors stored in the database 318 may be shared with other neighborsand/or the authorities 314 using the web interface 316. For example,when the unwelcomed visitors learn about the database 318 they may nottarget the neighborhood 302 a-302 n. Data in the database 318 may beused to classify types of visitors (e.g., comparisons may be performedbetween the captured video data and information in the database 318).

Multiple levels of alerts may be implemented to distinguish unwelcomedvisitors from welcomed visitors (e.g., household members). Since mostvisitors may be welcomed, identifying strangers and raising the level ofalert for immediate attention may be important. The technology toidentify and/or classify welcomed visitors may include facialrecognition, voice recognition, machine learning of habits and schedulesof household members, and/or user inputs when errors occur. Learnedbehavior may be used to determine which pre-defined function to perform.For example, the learned behavior may determine that nobody is home at aparticular time, and the pre-defined function may be to automaticallyarm the security system and/or perform energy saving functions (e.g.,adjust the heating and/or cooling of a home). In another example, thedaily schedule of inhabitants may be observed and/or recorded. The dailyschedule of inhabitants may be learned using various sensors. Forexample, patterns may be observed such as daily energy use requirementsat a certain time of day and/or the arming/disarming of a securitysystem. In another example, smart lighting may estimate the amount oflighting needed at a particular time of day based on the occupants in ahome. If nobody is home, the system 300 may determine that exteriorlighting is needed and/or interior lighting is not needed. In anotherexample, if a family is on vacation the system may turn on interiorlighting to make it appear to a potential burglar that the home isoccupied. The learned behavior may develop a unified status of the home(e.g., based on occupancy, time of day, weather, security status, etc.).Pre-defined functions may be performed based on the unified status ofthe home.

In some embodiments, the smart cameras 100 a-100 n may initiate storageof the video data (e.g., the video streams 162 a-162 b) in response tomotion detection in the area of interest. The user device 120 a (e.g., asmart phone) may be used to allow a user to set a motion threshold foreach of the smart cameras 100 a-100 n. For example, a lower motionthreshold may be more sensitive to motion. In another example, a highermotion threshold may be less sensitive to motion (e.g., reduce a numberof false positives). The motion threshold may be adjustable.

In some embodiments, the smart cameras 100 a-100 n may initiate storageof the video data (e.g., VS1-VS2) in response to detecting and/orlocating a person (e.g., the visitor 170) and/or other type of object(e.g., the car 172) in the video data. In one example, the videoprocessor 106 of the smart cameras 100 a-100 n may analyze the videodata to detect people and/or animals. In some embodiments, facialrecognition may be implemented to classify and/or recognize visitors.The activation state may be selected based on the classification. Insome embodiments, the video data may be analyzed to determine a behaviorof the visitors.

In some embodiments, machine learning techniques may be implemented toimprove detection and/or classification accuracy of visitors and/orobjects. For example, the user may be able to provide a correct and/orincorrect label to a detection performed by the smart cameras 100 a-100n. If the detection and/or classification is incorrect, the incorrectlabel may be used by the smart cameras 100 a-100 n to incorporate anincorrect result of the detection into the machine learning techniques.In some embodiments, the machine learning techniques may be implementedin the cloud service (e.g., the analysis is performed using cloudcomputing resources configured to scale available resources on demand).Video data and/or correct/incorrect labels may be uploaded and/or storedanonymously (e.g., without personal identification information). Thesmart cameras 100 a-100 n may be configured to ignore (e.g., not respondto, not track and/or not send notifications in response to) smallanimals and/or shadows.

In some embodiments, the smart security cameras 100 a-100 n may beconfigured to send notifications to the user devices 120 a-120 n inresponse to the detection. For example, a text message and/or an emailmay be transmitted in response to the notification. In another example,a notification may be sent via an API (e.g., push notifications) for aparticular operating system (e.g., Android notifications, iOSnotifications, Windows notifications, etc.). Generally, the user 62 maycreate a user account (e.g., comprising at least an email address and apassword as credentials) for the cloud service (e.g., using thecompanion application 160 and/or the web-based interface 316). The useraccount may allow the user to configure preferences. The preferences maycomprise the notification settings. The type of notifications sent bythe smart cameras 100 a-100 n may be based on the notification settings.The smart cameras 100 a-100 n may implement the activation states and/orarm/disarm the security responses to limit a number of the notificationssent. Intelligently limiting the number of notifications sent may reducea number of false alarms and/or reduce an amount of data transferred viathe network 310 (e.g., prevent QoS issues and/or dropped data).

The cloud service 310 and/or the database 318 may store portions of thevideo data VS1-VS2 from each of the smart cameras 100 a-100 n. Forexample, portions of the video data may be saved in response to theparticular types of detections. The portions of video data may be videoclips. The video clips may be encoded and/or compressed by the videoprocessor 106 to reduce a size of storage capacity of the video clips.The video clips may have a limited video length (e.g., 30 seconds, oneminute, 90 seconds, five minutes, etc.). The length of the video clipsmay be based on the configuration preferences and/or in response to thedetections by the smart cameras 100 a-100 n (e.g., a longer video clipmay result in response to continuous detections). In some embodiments,the video clips may be pre-padded and/or post-padded with video databefore and/or after the detection. For example, the video clip may storevideo data from a pre-determined time before and/or after the detection(e.g., 30 seconds before the detection and/or 30 seconds after thedetection for a video clip approximately one minute long).

In some embodiments, a user interface may be provided for the userdevices 120 a-120 n (e.g., the companion application 160, an executableprogram, the web-based interface 316, etc.). The user interface mayallow one or more of the user devices 120 a-120 n to control variouscomponents of the smart cameras 100 a-100 n. For example, one or moreuser devices 120 a-120 n may be configured to access the user account.The control signals may be generated in response to the input from theuser devices 120 a-120 n. For example, an icon may be provided on theuser interface representing a light bulb (e.g., the control 164 f). Theuser 62 may activate and/or deactivate the light bulb 80 by pressing(touching on a touchscreen, clicking, etc.) the icon 164 f.

Other components such as security response components may be turned onand/or off from the user interface 160. For example, the icon 164 d maybe provided to allow the user to control the speaker of one or more ofthe smart cameras 100 a-100 n. In one example, the speaker of the smartcameras may playback a pre-recorded audio message (e.g., the user 62 mayselect from one or more pre-recorded audio messages on the userinterface). In another example, the speaker of the smart cameras 100a-100 n may sound an alarm (e.g., one or more alarm types may beselected from the user interface 160).

In some embodiments, the smart cameras 100 a-100 n may be configured fortwo-way audio communications (e.g., an intercom). For example, the voiceof a visitor may be received using a microphone component of the circuit104. The circuit 104 may receive the audio data via the microphone. Thecommunication module 108 may transmit the received audio to one or moreof the user devices 120 a-120 n. The user devices 120 a-120 n mayplayback the audio to the user 62. The user 62 may speak via themicrophone 154 on the user devices 120 a-120 n. The user devices 120a-120 n may transmit the audio to one or more of the smart cameras 100a-100 n (e.g., the user 62 may select which of the smart cameras 100a-100 n to playback the audio using the companion application 160) viathe communication module 108 (e.g., a Wi-Fi connection). The speakercomponent of the apparatus 100 may transmit and/or stream the receivedaudio.

The smart cameras 100 a-100 n may provide various APIs (applicationprogramming interface) to connect with other devices (e.g., other homeautomation devices). For example, the APIs may allow various otherdevices to communicate with the smart cameras 100 a-100 n. In oneexample, the companion application 160 may be configured toreceive/transmit data between the apparatus 100 and/or other smartdevices (e.g., the smart security light 210). For example, the smartcameras 100 a-100 n and/or a number of smart security lights 210 (e.g.,comprising similar video processing capabilities as the smart cameras100 a-100 n) may provide a smart home security system. The smart cameras100 a-100 n may generate control signals based on the communication withthe various devices other devices. The types of APIs available may bevaried according to the design criteria of a particular implementation.

A package deposit 330 is shown at the home 302 a. The package deposit330 may be implemented to allow the visitor 170 to deliver packages(e.g., the package 180). The package deposit 330 may be implemented as acontainer, a bag, a delivery slot, a mailbox, etc. In an example, thepackage deposit 330 may be implemented as a large net with a zipper anda lock. A delivery person may be instructed by the smart securitycameras 100 a-100 n to place a package inside the package deposit 330and zip up and/or lock the package deposit 330. In some embodiments, thepackage deposit 330 may implement a hazardous waste storage (e.g.,medical waste for a medical facility) and the package deposit 330 may bemonitored to ensure proper disposal of materials in the package deposit330 (e.g., the package deposit 330 may be implemented for packagepick-up). The implementation of the package deposit 330 may be variedaccording to the design criteria of a particular implementation.

A wireless device 332 is shown on the package deposit 330. The wirelessdevice 332 may be configured to transmit wireless signals to indicate astatus of the package deposit 330. In an example, the wireless device332 may send a notification to the smart cameras 100 a-100 n indicatingthat the package has been delivered. In another example, the wirelessdevice 332 may be configured to send a notification to the smartsecurity cameras 100 a-100 n indicating that the package deposit 330 hasbeen tampered with. The smart cameras 100 a-100 n may forward thenotification to one or more of the user devices 120 a-120 n. The type ofnotifications transmitted by the wireless device 332 may be variedaccording to the design criteria of a particular implementation.

The smart security cameras 100 a-100 n may be configured to adjust anactivation state in response to the package 180 being delivered and/orpicked up (e.g., in response to the notification from the wirelessdevice 332). A security zone is shown in the field of view 116 a-116 b(e.g., the field of view of the lens 130 b of the apparatus 100 n). Thesmart security camera 100 n may monitor the security zone within thefield of view 116 a-116 n near the package deposit 330. In an example,when the security zone 116 a-116 n is invaded (e.g., by a visitor suchas a potential package thief) the smart camera 100 n may be configuredto perform a security response (e.g., activate an alarm, send an alertto a designated user, etc.). The security zone 116 a-116 n may be thearea of interest 118 b below the apparatus 100 n. In some embodiments,the capture device 102 b may be configured to capture packageinformation about the delivered package 180 (e.g., a bar code, atracking number, an identification of the delivery person, etc.).

Referring to FIG. 10, a diagram illustrating a rear view of the internalcomponents of an exemplary embodiment of the apparatus 100 is shown. Theapparatus 100 may comprise the circuit board 104. The circuit board 104may comprise a number of components and/or connectors. The videoprocessor 106 and the communication device 108 are shown on the circuit108 along with other components. An illustrative example of the variouscomponents and/or connectors is shown. The number, type and/orarrangement of the components and/or connectors may be varied accordingto the design criteria of a particular implementation.

Connectors 350 a-350 b are shown. The connectors 350 a-350 b may beimplemented as ribbon-type connectors. The connector 350 a is shownconnecting the capture device 102 a to the circuit 104. The connector350 b is shown connecting the capture device 102 b to the circuit 104.The connectors 350 a-350 b may be configured to provide a high-speedvideo data link between the capture devices 102 a-102 b to the videoprocessor 106 on the circuit 104. The high-speed video data transmissionlink may enable real-time video processing and/or video analysis togenerate the video streams VS1-VS2 from the captured video frames 110a-110 n and/or 112 a-112 n. For example data captured by the imagesensors of the capture devices 102 a-102 b may be presented to the videoprocessor 106 and/or video processors via the connectors 350 a-350 b toenable the video processor 106 and/or processors to process, analyze,compress and/or package the video for streaming/recording.

A speaker 352 is shown. The speaker 352 is shown mounted within theapparatus 100 next to the speaker grille 134. The speaker grille 134 mayprovide an opening to enable the audio generated by the speaker 352 tobe transmitted outside of the apparatus 100. A connector 354 is shownconnecting the speaker 354 to the circuit 104.

In the example shown, the circuit 104 may comprise the video processor106, the communication device 108, a block (or circuit) 356, a block (orcircuit) 358, a block (or circuit) 360 and/or a block (or circuit) 362.The circuit 356 may implement an audio processing component. The circuit358 may implement a microphone component. The circuit 360 may implementa storage component. The circuit 362 may implement a power storageand/or conversion component. The circuit 104 may comprise othercomponents (not shown).

The audio processing component 356 may be configured to encode, decodeand/or play back audio. In an example, the audio processing component356 may be configured to play back pre-recorded audio stored in thestorage component 360 (e.g., pre-recorded greetings, alarms, music,etc.). In another example, the audio processing component 356 may beconfigured to play back audio received from the user device 120 inreal-time.

The microphone component 358 may be configured to receive audio data(e.g., from the visitor 170). In one example, the microphone component358 may capture the audio input and present the audio input to thecommunication device 108 for streaming to the user device 120. Inanother example, the microphone 358 may capture the audio input andpresent the audio input to the audio processing component 356 forencoding (e.g., to be stored by the storage component).

The storage component 360 may be configured to store computer readabledata. In one example, the storage component 360 may be a non-volatilestorage medium. In another example, the storage component 360 may be acombination of non-volatile and volatile memory. The storage component360 may store audio data (e.g., the pre-recorded audio for playback, thereceived audio), video data (e.g., the video streams VS1-VS2), computerreadable instructions and/or other data.

The power storage and/or adapter component 362 may be configured toreceive and/or supply power to the components of the apparatus 100. Inone example, the power storage component 362 may be a battery (e.g.,rechargeable) configured to supply power to the circuit 104 (e.g., theapparatus 100 may comprise a solar panel for capturing energy torecharge the battery). In another example, the power storage and/oradapter component 362 may be configured to convert an AC power supply toDC power usable by the circuit 104. In yet another example, the powerstorage and/or adapter component 362 may be configured to regulate powerprovided to the apparatus 100.

In the example shown, the connector 206 a is shown as a port to thecircuit board 104. The port 206 a may be a USB connector configured toprovide power to the apparatus 100. The power adapter component 362 maybe configured to regulate and/or store the power received via theconnector 206 a. In some embodiments, the port 206 a may enable datacommunication (e.g., for firmware upgrades, for configuration, etc.).

The circuit 104 and/or the capture devices 102 a-102 b are shown withina housing 370 of the apparatus 100. In one example, the housing 370 maybe a plastic material. In another example, the housing 370 may be aweatherproofed material configured to operate in outdoor conditions(e.g., rain, snow, heat, etc.). The type of housing implemented may bevaried according to the design criteria of a particular implementation.

A compartment 380 is shown. The compartment 380 may be hollow. Thecompartment may have a lock/latch 382. In the example shown, thecompartment 380 may contain a key 384. For example, the key 384 may beused to gain entry to the premises 302 a. The size, location and/or typeof objects stored in the compartment 380 may be varied according to thedesign criteria of a particular implementation.

The latch 382 may be controlled by the circuit 104. For example, thecircuit 104 may enable the latch 382 to remotely lock/unlock thecompartment 380. In an example, the companion application 160 mayprovide an option to unlock the latch 382 (e.g., a homeowner may receivea notification that a delivery person has arrived with the package 180and may remotely unlock the compartment 380 to allow the delivery personto access the key 384 to drop off the package 180 in the home). Inanother example, the video processor 106 may perform facial recognitionto identify the visitor 170. If the visitor 170 is recognized as aperson that may enter the premises 302 a (e.g., a neighbor checking on ahome while the homeowners are on vacation), the circuit 104 may unlockthe latch 382 to enable the visitor 170 to use the key 384.

Referring to FIG. 11, a diagram illustrating a context 50 of theapparatus 100′ implementing a wedge attachment to change a viewing angleof the capture devices 102 a-102 b is shown. The apparatus 100′ is shownattached to a wedge 400. The wedge 400 may be attached to the wall 52.The wedge 400 may be used to adjust the angle of the fields of the viewof the capture devices 102 a-102 b. In the example shown, the wedge 400may direct the apparatus 100′ downwards providing a lower angle point ofview for the front facing lens 130 a and providing more viewing areabehind the apparatus 100′ for the lens 130 b. In another example, thewedge 400 may be angled to direct the apparatus 100′ to provide anupward angle for the field of view of the lens 130 a. In someembodiments, the wedge 400 may provide an adhesive to attach to theapparatus 100′ and/or the wall 52. In some embodiments, the wedge 400may comprise female slots and/or bayonet mounts for connecting to thewall 52 and/or the apparatus 100′. The implementation of the wedge 400may be varied according to the design criteria of a particularimplementation.

In the example shown, the apparatus 100′ may have the compartment 380.The compartment 380 is shown on the side of the apparatus 100′. Thecompartment 380 may be unlocked remotely to enable the visitor 170 tograb the key 384, if the visitor 170 is given permission (e.g., byfacial recognition performed by the processor 106, by the user 62providing access using the companion application 160, using thefingerprint scanner 202, etc.).

In some embodiments, the lenses 130 a-130 b may be adjustable. In theexample shown, the bottom of the apparatus 100′ may be configured toswivel to move the lens 130 b. A swivel portion 402 is shown sliding outof the apparatus 100′. The swivel portion 402 may slide and/or collapseinto the apparatus 100′. For example, the lens 130 b may adjust from aposition directly below the apparatus 100′ (e.g., when the swivelportion 402 is within the apparatus 100′) to a position angled moretowards the front of the apparatus 100′ (e.g., as shown by the lens 130b′). For example, the bottom of the apparatus 100′ may slide outwards tochange the field of view of the lens 130 b.

In some embodiments, the apparatus 100′ may comprise an attachment 404.The attachment 404 may be a rigidly flexible component. For example, theattachment 404 may be configured to be moved, positioned and/or shapedand retain the new shape. In the example shown, the attachment 404 is ona top portion of the apparatus 100′. However, the attachment 404 may belocated anywhere on the apparatus 100′. In an example, the attachment404 may be removably attached to the apparatus 100′.

An attachment end 406 is shown at the end of the attachment 404. In oneexample, the attachment end 404 may be a light source. For example, theattachment 404 may be configured to provide power to the light source404. In another example, the attachment end 406 may be a mirror and/orprism.

The mirror and/or prisms 406 may be configured to adjust the field ofview of the lenses 130 a-130 b. In the example shown, the lens 130 a mayhave the field of view 114 a′-114 b′. The mirror 406 may be attached tothe flexible attachment connector 404 to adjust the field of view 114a′-114 b′ of the front facing lens 130 b. A line 408 is shown. Themirror 406 may be angled to adjust the field of view to include thereflection 408. For example, the mirror 406 may be used to provide thefield of view 114 a′-114 b′ and the reflection 408 behind and/or belowthe apparatus 100′. In some embodiments, the prism may be implemented toenable one capture device to capture multiple and different fields ofview.

Referring to FIG. 12, a diagram illustrating a secure flexible mountembodiment 420 is shown. The flexible mount embodiment 420 may comprisea base 422, a flexible joint 424 and/or a mount (or holder) 426. Theflexible mount embodiment 420 may be an accessory for the apparatus 100.

The apparatus 100 may securely attach to the mount embodiment 420. Themount embodiment 420 may have the base 422 for attachment to a surface(e.g., a wall). The base 422 may comprise a high-quality speaker (e.g.,of better quality than the speaker 352 on the apparatus 100). Forexample, the speaker grille 134′ is shown on the base 422. The base 422may comprise a wireless communication component (e.g., Wi-Fi, Bluetooth,cellular, etc.) 430. The base may comprise a light and/or IR sensor 434to improve video captured at night.

The base 422 may comprise a hollow compartment 432 for holding a key.The hollow compartment 432 may be locked. The user device 120 may beused to unlock the hollow compartment 432 to allow a homeowner and/orapproved visitor to access the key inside. In some embodiments, thehollow compartment 432 may be implemented on the apparatus 100 (e.g.,the compartment 380).

The flexible joint 424 may be configured to adjust the direction of theapparatus 100 and the holder portion 426. The flexible joint 424 may beconfigured to be directed (angled) and/or rotated. The flexible joint424 may be moved while still providing support for the holder portion426 and a connection to the base 422. In some embodiments, the flexiblejoint 424 may comprise wiring to communicate data between the apparatus100 connected to the holder portion 426 and the base 422.

The holder portion 426 may securely hold the apparatus 100. The holderportion 426 may comprise a connector 436 (e.g., a magnet, double-sidedtape, a threaded connector, etc.) to securely attach to the apparatus100. The connector 436 may provide a secure attachment to the apparatus100 and/or an electrical connection. For example, the electricalconnection implemented by the connector 436 may enable the apparatus 100to send/receive data to/from the base 422. In an example, audio data maybe generated by the apparatus 100 (e.g., the audio processing component356) transmitted by the connector 436 through the flexible joint 424 tothe base 422 and the high-quality speaker of the base 422 may playbackthe audio data.

Referring to FIG. 13, a diagram illustrating a table-top docking station440 is shown. The docking station 440 may comprise a base 442, amotorized support 444 and a motorized support 446. The docking station440 may be an accessory for the apparatus 100.

The docking station 440 may be implemented as a table-top accessory forthe apparatus 100. The docking station 440 may provide a finished coverfor a back of the apparatus 100. The apparatus 100 may sit on themotorized support 444 and/or the motorized support 446. The motorizedsupport 444 and/or the motorized support 446 may provide 360 degreepanning and/or an adjustable 30 degree tilt for the apparatus 100.

The base 442 may comprise a connector 448. The connector 448 may providea mechanical support and/or an electrical connection. For example, theconnector 448 may be configured to provide mechanical support to keepthe apparatus 100 upright and/or aligned. In another example, theconnector 448 may provide DC power to the apparatus 100. In yet anotherexample, the connector 448 may communicate data and/or control signalsto/from the apparatus 100. For example, the companion application 160may be used by the user 62 to select a rotation angle and the apparatus100 may receive the instructions from the smartphone 120, generate thecontrol signals, and send the control signals to the motorized support444 and/or the motorized support 446 via the connector 448.

Referring to FIG. 14, a diagram illustrating a TV docking station 460 isshown. The TV docking station 460 may implement a webcam with a TVmounting bracket. The TV docking station 460 may comprise a base 462, aTV mounting bracket 464, a TV support 466, a flexible joint 468, aconnector 470 and/or an adjustable mount 472. The TV docking station 460may be an accessory for the apparatus 100.

The base 462 may provide support and/or a connection to a wall. The TVmounting bracket 464 may support a TV and/or monitor. The TV support 466may provide a secure connection to a TV and/or monitor. In one example,TV support may be an adjustable stand. In another example, the TVsupport may be a mount (e.g., a VESA mount). The TV mounting bracket 464and/or the TV support 466 may be used to hang a TV above the apparatus100.

The flexible joint 468 may connect to the base 462. The flexible joint468 may be configured to adjust the direction of the apparatus 100 andthe connector 470. The flexible joint 468 may be configured to bedirected (angled) and/or rotated. The flexible joint 468 may be movedwhile still providing support for the connector 470 and a connection tothe base 462. In some embodiments, the flexible joint 468 may comprisewiring to communicate data between the apparatus 100 connected to theadjustable mount 472 and the base 462.

The connector 470 may be configured to support the adjustable mount 472.The connector 470 may extend the adjustable mount 472 beyond theconnection to the TV so that the field of view of the apparatus 100 isnot obstructed by the TV held by the TV support 466. The adjustablemount 472 may be configured to support the apparatus 100. The adjustablemount 472 may be rotated and/or swiveled to adjust the areas within thefields of view captured by the apparatus 100.

The TV docking station 460 may be implemented to mount a TV/monitorand/or provide security to prevent theft of the TV. In an example, theTV docking station 460 may be used in a public area such as sports bars,restaurants, reception areas, etc. The apparatus 100 attached to theadjustable mount 472 may capture the video streams VS1-VS2 of anyoneattempting to steal the mounted TV (e.g., anyone approaching the TVand/or anyone under the TV).

Referring to FIG. 15, a diagram illustrating a perspective view 500 ofan example embodiment of the invention is shown. The apparatus 100″ isshown. The perspective view 500 of the apparatus 100″ may show theforward facing lens 130 a′, the bottom lens 130 b′, the speaker grille134′, the button 136′, the cable 204′ and/or the housing 370′. In someembodiments, the forward facing lens 130 a′ may be angled slightlyupwards.

The apparatus 100″ may further comprise lights 502 a-502 b. In someembodiments, the lights 502 a-502 b may be implemented to illuminate thearea 118 b. For example, if the capture device 102 b has a lower imagequality than the capture device 102 a, illumination using the lights 502a-502 b may improve video data captured in dark environments. In someembodiments, the lights 502 a-502 b may implement IR scanners. The IRscanners implemented using the lights 502 a-502 b may be configured todetect and/or scan various codes (e.g., bar codes, tracking numbers, QRcodes, etc.). For example, if the package 180 is left under theapparatus 100″, the lights 502 a-502 b may scan the tracking number andprovide a notification to the user 62 via the companion application 160.

The apparatus 100″ may further comprise a status light 504. The statuslight 504 may indicate an operational mode of the apparatus 100″. In oneexample, the status light 504 may be off when the video data is notbeing recorded (e.g., no visitors or objects are detected and the videodata is captured and analyzed, but not stored long term). In anotherexample, the status light 504 may be colored red to indicate that thevideo data is being recorded. In yet another example, the status light504 may be orange to indicate that the apparatus 100″ is in an armedstate (e.g., the package 180 has been detected and the apparatus 100″ ison high alert for potential package thefts). The color of the statuslight 504 and/or the various operating modes of the apparatus 100″ maybe varied according to the design criteria of a particularimplementation.

Referring to FIG. 16, a diagram illustrating a front view 520 of anexample embodiment of the invention is shown. The apparatus 100″ isshown. The front view 520 of the apparatus 100″ may show the forwardfacing lens 130 a′, the bottom lens 130 b′, the speaker grille 134′, thebutton 136′, the lights 502 a-502 b and/or the status light 504.

A bottom portion of the apparatus 100″ is shown angled forward. Forexample, angling the bottom portion forward may enable the bottom lens130 b′ to be visible from the front view 520. Angling the bottom lens130 b′ may enable the field of view 116 a-116 b to partially overlapwith the field of view 114 a-114 b of the forward lens 130 a′. When thetwo fields of view 114 a-114 b and 116 a-116 b overlap, a portion of thearea 118 a and a portion of the area 118 b may have form a common fieldof view (e.g., the area 132 shown in association with FIG. 2). Theapparatus 100″ may be configured to triangulate a distance to movingobjects in the common field of view. Triangulating the distance ofmoving objects may enable the video processor 106 to differentiatebetween objects that might be interesting and/or noteworthy (e.g.,visitors approaching the premises 302 a, the package 180 beingdelivered, a vehicle driving up the driveway) and other types ofmovement (e.g., distant cars driving by on the street, shadows, trees,bushes, etc.).

The overlapping field of view (e.g., the area 132) may enable the videoprocessor 106 to implement stereo vision. The stereo vision may enablethe apparatus 100″ to determine the distance, size, speed and/ordirection of movement of an object based on analyzing the two differentperspectives of the overlapping field of view 132 captured by thecapture devices 102 a′-102 b′. In one example, with the apparatus 100″mounted at approximately 4 feet high and with the bottom lens 130 b′ ata 60 degree angle, the lenses 130 a′-130 b′ may have the overlappingfield of view 132 at lower than 3 feet in height and at a distance ofabout 1.5 feet and goes to 0 feet (e.g., ground level) at a distance ofabout 6.5 feet. The location of the overlapping field of view 132 maychange when the mounting height of the apparatus 100″ is varied and/orthe field of view 116 a-116 b of the bottom lens 130 b′ is adjusted. Thelocation of the overlapping field of view 132 may be varied according tothe design criteria of a particular implementation.

Information determined by the video processor 106 about objects in theoverlapping field of view 132 using the stereo vision may be presentedto the companion application 160. For example, the user 62 may receiveinformation corresponding to a direction of movement of the objectand/or a distance of an object to the apparatus 100″ on the companionapplication 160.

In some embodiments, the button 136′ may comprise the fingerprintscanner 202. In some embodiments, the fingerprint scanner 202 may beused by the apparatus 100″ to control a door lock and/or doorbell. Forexample, the fingerprint scanner 202 may detect the fingerprint of thefinger pressing the button 136′ and store the fingerprint (e.g., in thememory 360 and/or the cloud database 318). The apparatus 100″ (or thecloud service 310 using cloud processing) may be configured to reviewand/or categorize the fingerprint of each person detected for futuredetection of the same fingerprint.

The stored fingerprint may be used by the apparatus 100″ to perform anoperation (e.g., generate control signals) when the same fingerprint isdetected again. For example, if the fingerprint is the homeowner, whenthe fingerprint scanner 202 detects the same fingerprint, the apparatus100″ may generate a control signal to unlock the door (e.g., one or moreof the access points 304 a-304 n) and/or unlock the compartment 380. Inanother example, if the fingerprint is a delivery person, when thefingerprint scanner 202 detects the same fingerprint, the apparatus 100″may generate a control signal to unlock a particular entrance (e.g.,access to a location for depositing the package 180). In yet anotherexample, if the fingerprint is an unwanted guest (e.g., a door-to-doorsalesperson), when the fingerprint scanner 202 detects the samefingerprint, the apparatus 100″ may deactivate the doorbell feature(e.g., so the homeowner can ignore the salesperson without beingdisturbed by a doorbell chime).

Other responses based on the fingerprint detected by the fingerprintscanner 202 may comprise sending an alert to the user 62 (e.g., via thecompanion application 160), sending an alert to the receptionist 312(e.g., a private security firm) and/or sending an alert to theauthorities 314. The categories of visitor detecting using fingerprintsand/or the control signals (e.g., responses) generated by the apparatus100″ may be varied according to the design criteria of a particularimplementation. Similar detections and/or responses by the apparatus100″ may be implemented using facial recognition implemented by thevideo processor 106. Implementing the database of fingerprints and thefacial recognition may provide more accurate detection and/oridentification of the visitor 170.

Referring to FIG. 17, a diagram illustrating a rear view 540 of anexample embodiment of the invention is shown. The apparatus 100″ isshown with the cable 204′ unplugged and the cable 204′ plugged in. Therear view 540 of the apparatus 100″ may show the housing 370′, the cable204′, the connector 206 a′, a cable slot 542, a rear panel 544 and/ormounting screws 546 a-546 b.

The cable slot (or pocket) 542 is shown as an opening on the rear of thehousing 370′. The cable slot 542 may be configured to fit one or moretypes of the cable 204′ and/or the connector 206 a′. The cable slot 542may be configured to enable the cable 204′ and/or the connector 206 a′to connect to the apparatus 100″ (e.g., to the circuit 104) and fitflush (or inset) on the housing 370′. For example, the cable slot 542may ensure that the cable 204′ and/or the connector 206 a′ does notprotrude from the apparatus 100″ (e.g., protruding from the rear mayprevent a flush mount on a flat surface). In the example shown, thecable 204 a′ may be a USB cable and the connector 206 a′ may beimplemented as a right angle connector. The shape and/or size of theconnector slot 542 may be varied according to the design criteria of aparticular implementation.

The rear panel 544 may be inset on the rear of the housing 370′. Therear panel 544 may be comprise various components for connecting to theapparatus 100″ and/or the mount the apparatus 100″ to a wall (e.g., avertical surface). In the example shown, the rear panel 544 may comprisethe mounting screws 546 a-546 b. The mounting screws 546 a-546 b may beconfigured to enable the apparatus 100″ to be mounted flush against thewall 52 (e.g., a vertical surface). The implementation of the mountingscrews 546 a-546 b may be varied according to the design criteria of aparticular implementation.

Referring to FIG. 18, a diagram illustrating an exploded view 560 of anexample embodiment of the invention is shown. In the exploded view 560,various example components of the apparatus 100″ are shown. The cable204′ and the connector 206 a′ are shown. The housing 370′ is shown. Thecircuit boards 104 a′-104 b′ are shown. An upper front cover 562 and alower front cover 564 are shown. And the button 136′ is shown. Theapparatus 100″ may comprise other components (not shown). The number,type and/or arrangement of the components of the apparatus 100″ may bevaried according to the design criteria of a particular implementation.

The upper front cover 562 may comprise an opening 566. The opening 566may be configured to fit the lens 130 a′. The lower front cover 564 maycomprise the speaker grille 134′, an opening 568 and/or an opening 570.The opening 568 may be configured to fit the button 136′. The opening570 may be configured to fit the lens 130 b′. The lower front cover 564may further comprise a light pipe (e.g., for the lights 502 a-502 b).

In the example shown, the apparatus 100″ may comprise the circuit boards104 a′-104 b′. In some embodiments, the circuit 104 may be implementedas a single circuit board. The arrangement and/or number of circuitboards for implementing the functionality of the circuit 104 may beconfigured based on size and space constraints of the housing 370′. Forexample, if the apparatus 100″ is implemented as a video doorbell withtwo fields of view, the space constraints of the housing 370′ may beabout the size of a standard doorbell and/or discreet security camera.Similarly, the various components on the circuit boards 104 a′-104 b′may be arranged (e.g., placement on the board, which side of the boardthe component is located on, which board the component is on, etc.)according to various constraints (e.g., size, space, thermal,communication, etc.).

In the example shown, the circuit board 104 a′ may comprise the capturedevices 102 a′-102 b′, the video processor 106, the lenses 130 a′-130 b′(e.g., connected to the capture devices 102 a′-102 b′), the fingerprintscanner 202′, the speaker 352′, the audio processor 356′, the microphonecomponent 358′, and/or the lights 502 a-502 b (e.g., connected to thelens 130 b′). The circuit board 104 b′ may comprise the wirelesscommunication device 108, the storage component 360′ and/or the powerstorage/power conversion component 362′.

The memory 360′ may store images, audio, and/or other data. Data storedin the memory 360′ may be compared to various signals from sensormodules implemented by the circuits 104 a′-104 b′. In one example, thedata stored in the memory 360′ may be a password. The processor 106 maycompare the password with signals from the sensor modules. Thecomparison may determine which control signals to generate.

The speaker 352′ may generate audio signals. The speaker 352′ may beimplemented as one or more speakers. In one embodiment, the speaker 352′may be configured to generate a moderate volume sound (e.g., 75 dB at arange of 1 meter). However, the particular volume generated may bevaried to meet the design criteria of a particular implementation.

In another embodiment, the audio processing component 356′ may beconfigured to stream audio signals from the mobile devices 120 a-120 n,and/or other devices within range of the apparatus 100″. Thecommunication module 108 (e.g., a Wi-Fi antenna) may be configured tocommunicate with the mobile devices 120 a-120 n, and/or other devices tosend and/or receive audio signals. In some embodiments, thecommunication module 108 may comprise a connection port that may beconfigured to communicate with various devices to send and/or receiveaudio signals (e.g., via USB). The audio signals may be stored in thememory 360′. In one example, the speaker 352′ may generate audio signalsto attract outdoor wildlife and/or chase away undesired wildlife. Theapparatus 100″ may capture images of the wildlife. Images may be storedin the memory 360′. An alert may be sent to the user via the companionapplication 160.

The microphone component 358′ may receive audio signals. Audio signalsdetected by the microphone 358′ may be used by the circuits 104 a′-104b′ to generate various control signals. In one example, audio signalsgenerated by the visitor 170 may be received by the microphone 358′ togenerate a control signal used to control the light bulb 80, and/orcontrol the door 174 (e.g., opening, closing, and/or locking a door).Audio signals detected by the microphone 358′ may be used as an audiopassword. For example, voice recognition may be used to generate apassword. The audio password may be needed to allow the apparatus 100″to generate various control signals.

The communication module 108 may receive and/or transmit data signals.The communication module 108 may register electromagnetic signals,acoustic signals, and/or other signals. The communication module 108 mayprovide control signals to turn on the light bulb 80, create sound fromone or more speakers, send alerts to users, and/or send other wirelesssignals.

The power adapter 362′ may receive electrical power from the premises.Electrical power from the premises may be presented to the circuits 104a′-104 b′. The power adapter 362′ may convert the electrical power. Theconverted electrical power may provide a power supply to the variouscomponents attached to the circuit boards 104 a′-104 b′. In one example,the power adapter 362′ may be implemented as a 5V power adapter.

In some embodiments, the apparatus 100″ may comprise a configurationport. In an example, the cable 204′ may connect to the configurationport. The connection port may be configured to connect to an externaldevice such as a computer and/or mobile device. The configuration portmay be configured to allow the user 62 to have access to a Wi-Fi setupfor the communication module 108, store data (e.g., audio files) in thememory 360′ and/or update firmware. The firmware may be stored on thememory 360′. The firmware may store instructions that, when executed bythe processor 106, implement one or more steps and/or control actions.

The circuits 104 a′-104 b′ may comprise various sensor modules (e.g.,environmental sensors). In an example, the circuits 104 a′-104 b′ maycomprise an electromagnetic field sensor, an acoustic field sensor, avoice recognition sensor, a facial recognition sensor, a gesture sensor,a weather sensor and/or other sensors (e.g., a PIR motion detector todetect people and/or animals). One or more of the sensor modules, or acombination of the sensors modules may be implemented internally (e.g.,within the housing 370′), or alternatively may be implemented externally(e.g., as a separate sensing device coupled to the apparatus 100″).Input received by the sensor modules may be used to generate controlsignals.

In one example, the electromagnetic field sensor may detectelectromagnetic fields generated by appliances, other electronics,and/or other sources of electromagnetic fields within the range of theapparatus 100″. Disturbances in the electromagnetic field may be used bythe processor 106 to detect potential visitors and/or other objects.

In one example, the acoustic field sensor may detect acoustic fieldsgenerated within the range of the apparatus 100″. Such disturbances inthe acoustic field may be used to detect potential visitors and/or otherobjects.

In one example, the voice recognition sensor may be configured torecognize audio signals such as voices. The microphone 358′ may presentaudio signals to the voice recognition sensor. Signals detected by thevoice recognition sensor may be used by the apparatus 100″ to generatevarious control signals. In one example, audio signals and/or a commandvoice may be needed (e.g., a password) to allow the apparatus 100″ togenerate various control signals (e.g., open the compartment 380). Thevoice recognition sensor may be implemented by the audio processor 356′.

In one example, the facial recognition sensor may be configured torecognize the facial and/or other features of a person and/or of otherobjects. Signals detected by the facial recognition sensor may be usedby the video processor 106 to generate various control signals. In oneexample, facial recognition and/or recognition of other features of aperson and/or other object may be needed to allow the apparatus 100″ togenerate various control signals.

In one example, the gesture sensor may be configured to recognizegestures and/or movement of a person and/or other object. Signalsdetected by the gesture sensor may be used by the processor 106 togenerate various control signals. In one example, a particular gestureand/or combination of movements may be needed to allow the processor 106to generate various control signals. The facial recognition sensorand/or the gesture sensor may be implemented by the video processor 106.

In one example, the weather sensor may be configured to detect variousweather variables such as temperature, humidity and/or atmosphericpressure. The weather sensor may be comprised of a photodiode. Thephotodiode may be configured to determine daytime, nighttime, and/or theamount of light in the environment. Signals detected by the weathersensor may be used by the apparatus 100″ to generate various controlsignals. In one example, notifications about the weather may be sent tothe user 62 using the companion application 160. In another example, theamount of light in the environment may be used to control curtainsand/or blinds to prevent and/or allow a particular amount of lightthrough a window. In another example, light intensity of the light bulb80 may be increased as light in the environment decreases. An increasein light intensity of the light bulb 80 may ensure there is sufficientlight for the capture devices 102 a′-102 b′ to properly function.Controlling light intensity of the light bulb 80 may eliminate the needfor an IR light source in a camera during nighttime operation. The IRlight source may be implemented in the light bulb 80.

The capture devices 102 a′-102 b′ may be configured to capture videodata. For example, the capture devices 102 a′-102 b′ may each implementa 720p HD video camera. In some embodiments, the capture devices 102a′-102 b′ may each capture video data at different resolutions. Thevideo data may be high-resolution video frames and/or audio data. Thequality of the video data may be varied according to the design criteriaof a particular implementation. Generally, the quality of the video datais enough to support object detection (e.g., facial recognition, motiondetection, object identification, tagging, etc.).

The lenses 130 a′-130 b′ may be configured to receive and/or focus lightfrom the surrounding environment. The light received and/or focused bythe lenses 130 a′-130 b′ may be provided to the capture devices 102a′-102 b′. In some embodiments, a lens cover may be implemented for thelenses 130 a′-130 b′. The lens cover may be configured to cover a topportion of the lenses 130 a′-130 b′. The lens cover may be configured toreduce an amount of glare captured in the video data.

The video processor 106 may be configured to perform various videooperations. The video processor 106 may generate video data (e.g., thevideo streams VS1-VS2) in response to the video frames 110 a-110 ncaptured by the capture device 102 a′ and the video frames 112 a-112 ncaptured by the capture devices 102 b′. The video processor 106 may beconfigured to encode and/or decode video data into various formats. Thevideo processor 106 may be configured to compress and/or stream videodata.

The video processor 106 may be configured to analyze the video data inreal time. The video analysis performed by the video processor 106 maydetect, recognize and/or classify objects. For example, the objects maycomprise people (e.g., the visitor 170), animals, inanimate objects(e.g., the package 180), etc. The video analysis may be configured tolearn patterns, recognize objects and/or recognize faces. The videoprocessor 106 may be configured to de-warp the video captured (e.g.,correct lens distortions). The video processor 106 may be configured tocombine multiple fields of view into one image.

In some embodiments, the lights 502 a-502 b may be IR sensors. The IRsensors 502 a-502 b may be used to detect motion. For example, one ofthe sensor modules may be the IR (or PIR) sensor. In some embodiments,information from the IR sensors 502 a-502 b may be used to activate thecapture devices 102 a′-102 b′ (e.g., begin recording). In someembodiments, the IR sensors 502 a-502 b may provide additionalinformation to the capture devices 102 a′-102 b′ to detect visitors. Thesensitivity of the IR sensors 502 a-502 b may be adjustable. Forexample, the application 160 may be provided to the user 62 (e.g., aprogram, a web-based front end interface, a mobile application, etc.) toadjust the sensitivity of the capture devices 102 a′-102 b′ and/or theIR sensors 502 a-502 b.

The apparatus 100″ may be configured to be weatherproof. The apparatus100″ may be installed at indoor and/or outdoor locations. For example,the apparatus 100″ may be waterproof and/or water resistant. Theapparatus 100″ may be configured to operate in direct sunlight, coldclimates and warm climates. For example, the apparatus 100″ may operatein temperatures ranging from −40 F to 131 F. The apparatus 100″ may havean ingress protection marking and/or an international protection markingrating of IP44. For example, the apparatus 100″ may be effectivelyprotected against water splashing against the housing 370′ from anydirection and/or protected against objects (e.g., wires, screws, etc.)greater than 1 mm in size.

The communication module 108 may be configured to connect to a localnetwork and/or a wide area network (e.g., the internet). In someembodiments, the communication module 108 may be configured to implementone or more types of communications protocols. For example, thecommunication module 108 may support a Wi-Fi connection and/or aBluetooth connection. In some embodiments, the communication module 108may be distributed as multiple circuits on the circuits 104 a′-104 b′(e.g., a processing chip for each communications protocol). Other typesof communications protocols may be implemented according to the designcriteria of a particular implementation. In some embodiments, thecommunication module 108 may implement the Bluetooth connection toconnect to the user devices 102 a-102 n (e.g., a smartphone) to providean interface for configuring the apparatus 100″ (e.g., to allow the userto input local network settings). In some embodiments, the communicationmodule 108 may implement the Wi-Fi connection to connect to a cloudservice via the internet.

In some embodiments, the apparatus 100″ may be configured to upload data(e.g., the captured video data) to the cloud service. For example, thedata uploaded to the cloud service may be streamed to the user device.The user device may connect to the cloud service to allow the user torequest the stored video data. For example, the video data may be sentto the user device as a live (or nearly live) video stream. The datatraffic to/from the cloud services may be encrypted (e.g., AES 128-bitencryption, AES 256-bit encryption, etc.). User account passwords may besalted and hashed with a cryptographic hash function.

In some embodiments, the apparatus 100″ may store the captured videodata (e.g., in the memory 360′). In some embodiments, the video data maybe uploaded to the cloud service. Generally, the cloud service and/orthe memory 360′ may have a limited storage capacity. In someembodiments, the apparatus 100″ may analyze the captured video data(e.g., using the processor 106) and/or data from the IR sensor toperform a particular type of detection. For example, the apparatus 100″may detect objects, motion and/or visitors within 3 meters (e.g., 10feet). The apparatus 100″ may initiate storage of the video data inresponse to the particular type of detection. The detection performed bythe apparatus 100″ may be used to detect objects approaching thepremises.

For example, the apparatus 100″ may initiate storage of the video datain response to motion detection. The companion application 160 may beused to allow a user to set a motion threshold for the apparatus 100″.For example, a lower motion threshold may be more sensitive to motion.In another example, a higher motion threshold may be less sensitive tomotion (e.g., reduce a number of false positives). The motion thresholdmay be adjustable.

In some embodiments, the apparatus 100″ may initiate storage of thevideo data in response to detecting and/or locating a person and/orother type of object in the video data. For example, the apparatus 100″may analyze the video data to detect people and/or animals. In someembodiments, facial recognition may be implemented to identify and/orrecognize visitors. In some embodiments, the video data may be analyzedto determine a behavior of the visitors.

The video processor 106 may implement machine learning techniques toimprove detection accuracy of visitors and/or objects. For example, theuser may be able to provide a correct and/or incorrect label to adetection performed by the video processor 106. If the detection isincorrect, the incorrect label may be used by the apparatus 100″ toincorporate an incorrect result of the detection into the machinelearning techniques. In some embodiments, the machine learningtechniques may be implemented in the cloud service (e.g., the analysisis performed using cloud computing resources). Video data and/orcorrect/incorrect labels may be uploaded and/or stored anonymously(e.g., without personal identification information). The apparatus 100″may be configured to ignore (e.g., not respond to, not track and/or notsend notifications in response to) small animals and/or shadows.

In some embodiments, the apparatus 100″ may be configured to sendnotifications to the companion application 160 in response to thedetection. For example, a text message and/or an email may betransmitted in response to the notification. In another example, anotification may be sent via an API (e.g., push notifications) for aparticular operating system (e.g., Android notifications, iOSnotifications, Windows notifications, etc.). Generally, the user maycreate a user account (e.g., comprising at least an email address and apassword as credentials) for the cloud service (e.g., via an app and/ora web-based interface). The user account may allow the user to configurepreferences. The preferences may comprise the notification settings. Thetype of notifications sent by the apparatus 100″ may be based on thenotification settings.

In some embodiments, the notifications may be sent in response to theWi-Fi signal. For example, the cloud services may detect that theapparatus 100″ is no longer connected. The cloud services may send thenotification to the user device indicating that the Wi-Fi connection waslost and/or disconnected. The communication module 108 may be configuredto re-connect to the cloud services when the Wi-Fi connection isestablished.

In some embodiments, the apparatus 100″ may be configured for two-wayaudio communications (e.g., an intercom). For example, a visitor mayspeak through the microphone 358′. The microphone 358′ may receive theaudio data. The communication module 108 may transmit the received audioto the user devices 102 a-102 n. The user devices 102 a-102 n mayplayback the audio to the user 62. The user 62 may speak via the userdevices 102 a-102 n. The user devices 102 a-102 n may transmit the audioto the apparatus 100″ via the communication module 108 (e.g., a Wi-Ficonnection). The speaker 352′ may transmit and/or stream the receivedaudio.

The detection, the pre-recorded audio, the video streaming and/or thetwo-way audio communication may allow the user to observe thesurrounding environment of the apparatus 100″ from anywhere and at anytime. For example, the apparatus 100″ may be used to deter a burglarwhen a family is away from home (e.g., on vacation). In another example,the apparatus 100″ may alert the user 62 of the package 180 beingdelivered to the home and the user 62 may provide instructions to thedelivery person.

The system may combine multiple sensory signals (e.g., from theapparatus 100″) to accurately characterize the behavior of a visitor.Characterization of the behavior of the visitor may be performed and/orpresented to home/business owners in real time. For example,categorizations of the behavior of visitors may comprise the behaviortypical of potential burglars, solicitors, delivery workers, residents,domestic helpers, strangers, friendly visitors with and/or withoutaccess to the premises, etc. The number and/or type of behaviorcategorizations may be varied according to the design criteria of aparticular implementation.

Referring to FIG. 19, a diagram illustrating a side view of an exampleembodiment 100″ of the invention is shown. The components of theapparatus 100″ are shown (e.g., as a wireframe illustration) within theapparatus 100″. In the example shown, the components of the apparatus100″ are shown within the space constraints of the housing 370′ andcovered by the upper front cover 562 and the lower front cover 564. Thebottom lens 130 b′ is shown slightly protruding from the lower frontcover 564. The cable 204′ is shown extending down from the housing 370′.The connector 206 a′ is shown inset flush within the cable slot 542.

The circuits 104 a′-104 b′ are shown within the housing 370′. In theexample shown, the capture devices 102 a′-102 b′, the video processor106, and/or the power storage/conversion component 362′ are shown. Theconnector 350 a′ is shown connecting the capture device 102 a′ to thecircuit board 104 a′. The other components of the apparatus 100″ may bewithin the housing 100″ (not shown).

In some embodiments, the apparatus 100″ may be implemented as a doorbellcamera, a door camera and/or an indoor camera. The doorbell camera 100″receive wired power. In one example, the wired power may come from thecable 204′ (e.g., a USB cable). In another example, the doorbell camera100″ may receive power from standard doorbell wiring for the premises302 a-302 n. The apparatus 100″ may be implemented with no blind spot(e.g., to the front or below the apparatus 100″), to enable seeing thefront area 118 a and the bottom area 118 b (e.g., for viewing packagesin front of the door 174). In one example, the apparatus 100″ may beconfigured as a door camera system that may be mounted above the door174. The apparatus 100″ may implement a FBB camera (e.g., front, backand bottom). In some embodiments, the apparatus 100″ may be configuredas an indoor camera that may be a derivative of a doorbell style camera.

The apparatus 100″ may be implemented as a low-cost product with manybundled features. The apparatus 100″ may have an industrial design,beautiful and small. The apparatus 100″ may operate with a powerconsumption of 3 W or less. A low power implementation may ensure thatthe apparatus 100″ may receive power from a home doorbell system (e.g.,standard doorbell wiring). The wireless communication device 108 of theapparatus 100″ may provide a reliable Wi-Fi connection.

The apparatus 100″ may be configured to reduce blind spots. In anexample, the field of view 114 a-114 b may cover the front area 118 aand the field of view 116 a-116 b may cover the area 118 b below and/orbehind the apparatus 100″. The field of view 114 a-114 b and the fieldof view 116 a-116 b may have the overlapping region 132. For example,packages (e.g., the package 180) on the ground close to the door 174 maybe visible to the capture devices 102 a-102 b′. In another example, thefront door 174 may be visible, (e.g., the user 62 may see if the door174 is open and/or if any flyers 176 are on the door 174). The wedge 400may be used to help set the field of view 114 a-114 b and/or the fieldof view 116 a-116 b to cover the areas 118 a-118 b desired by the user62.

The apparatus 100″ may reduce a lag time for answering the door 174. Thecompanion application 160 may enable communication with the visitor 170within approximately 15 seconds. For example, when the visitor knocks onthe door 174, instead of the user 62 walking to the door 174 to reply tothe visitor 170, the companion app 160 may be used. For example, theapparatus 100″ may implement a two-way intercom to allow the user 62 tospeak to the visitor 170 without answering the door 174. In anotherexample, the user 62 may speak with the visitor 170 using the companionapp 160 even if the user 62 is not home (e.g., from work, while onvacation, while running errands, etc.).

The two camera lenses 130 a′-130 b′, the capture devices 102 a′-102 b′and/or the video processor 106 may be configured to provide differentvideo quality. In one example, the video processor 106 may be configuredto encode and/or process the video frames 112 a-112 n captured from thebottom lens 130 b′ to have a lower video quality than the video frames110 a-110 b captured by the forward facing lens 130 a′. For example, thereduced video quality for the video generated from the video frames 112a-112 n may be a lower resolution (e.g., 1080p for front capture deviceand 720P for bottom capture device). In some embodiments, the capturedevices 102 a′ may implement a 1080p, 16:9 ratio, 160 degree field ofview. In some embodiments, the capture device 102 b′ may provide480p/720p video. Generally, the amount of processing/resources used bythe video processor 106 to generate video from the video frames 112a-112 n captured by the bottom capture device 102 b′ may be less thanthe amount of processing/resources used by the video processor 106 togenerate video from the video frames 110 a-110 n captured by the forwardcapture device 102 a′.

The field of view 116 a-116 b of the bottom camera 102 b′ may be 80degrees down to see packages 180 and/or to see the door 174 about 3inches below the apparatus 100″. The camera angle may be adjustable by+/−15 degrees. The apparatus 100″ may be approximately 1.7 in×4.6 in×1.0in, operate at 16V AC-24V AC and/or implement a 10 VA transformer. Thecapture devices 102 a′-102 b′ may be implemented using a ⅓ inch,3-megapixel (2K) color sensor, provide video HD UXGA 1600×1200, providenight vision (e.g., 850 nm infrared LEDs 502 a-502 b) and/or operate at14° F. to 104° F. (−10° C. to 40° C.). The apparatus 100″ may provide achime connector to operate as a door chime (e.g., a doorbell). Theapparatus 100″ may be implemented with the wedge 400 (e.g., a 15°wedge). The wireless communication device 108 may be configured tosupport Wi-Fi 802.11a/b/g/n/ac, dual band and/or Bluetooth Low Energy(BLE).

In some embodiments, the apparatus 100″ may be mounted with a camerafloodlight (e.g., above a garage door) with a 155 degree diagonal lens.In an example, the lenses 130 a′-130 b′ may be approximately 12 inchesin front of the door, 3 inches above a passive infrared sensor (PIR)and/or 10 inches above the top of the door. In an example, the field ofview 114 a-114 n and/or the field of view 116 a-116 b may be up to 6feet in front of lenses 130 a′-130 b′ and 3 inches below the lens 130a′-130 b′. The garage door may be approximately at 12 inches behind thelens 130 b′. The apparatus 100″ may be about 5 inches in front of thedoor, and 4 feet above the ground.

In some embodiments, the apparatus 100″ may implement a door camera forall doors and/or access points 304 a-304 n of the premises 302 a-302 n.In some embodiments, the apparatus 100″ may receive light bulb powerfrom the power adapter 220 (e.g., from a light bulb 216 implementing theUSB port 218 and/or the light bulb socket adapter 250 providing thepower adapter 220′). The power from the light bulb adapter may be sharedby the apparatus 100″, the wall mounted bracket 420 (e.g., for an indoorcamera) and/or the smart light 210. The apparatus 100″ may be configuredto enable seeing and talking to people at the door 174. The apparatus100″ may be used with the companion application 160 to see if the door174 is secured or not (e.g., closed and locked).

In some embodiments, the apparatus 100″ may be implemented as an indoorcamera. The indoor version of the apparatus 100″ may use similarcomponents and/or electronics (e.g., the components of the circuit 104).Some features may be removed and/or added for the indoor version. Insome embodiments, a table-top docking station may be implemented (e.g.,as shown in association with FIG. 13). In some embodiments, the wallmount bracket 422 may be the same for an indoor camera as the doorcamera embodiment. The indoor docking station may implement the samePCB, electronics, lens, etc. as the outdoor embodiment. In someembodiments, the docking station and/or the mount 422 may provide aflexible secure mount (e.g., the flexible joint 424) for canary flex.

In some embodiments, one or more of the wedges 400 may be added to theapparatus 100″ to adjust the viewing angle. In some embodiments, theuser devices 120 a-120 n may be modified smartphones. For example, thesmartphones 120 a-120 n may be configured to operate using customizedsoftware (e.g., customized Android ROM and/or not a fully featuredphone) to provide a cordless handheld video intercom via the companionapplication 160. The user devices 120 a-120 n may enable the user 62 tohear chimes and/or be able to respond in a timely manner. Generally,users at home want to see and talk to visitors without opening the door.For example, using a dedicated phone app may be too slow to respond. Thecustomized smartphones 120 a-120 n may operate to quickly provide accessto the intercom feature and/or video. For example, the customizedsmartphone may be an always on solution to interact using the apparatus100″. For example, the customized smartphones 120 a-120 n may implementa direct Wi-Fi connection to the apparatus 100″ and/or cameras (e.g.,using a local area connection and/or peer-to-peer without internetaccess).

The apparatus 100″ may implement an RF transceiver for window/doorsensors. In an example, the lights 502 a-502 b may be configured as RFtransceivers. In some embodiments, the apparatus 100″ may be configuredto communicate with an indoor Wi-Fi light bulb to indicating someone athome. For example, the light bulb 80 may be implemented indoors and theapparatus 100″ may respond to detecting the visitor 170 by activatingthe light bulb 80 (e.g., via the Wi-Fi connection). Activating theindoor light bulb 80 in response to a detected visitor 170 may helpdeter a potential thief (e.g., by making the premises 302 a seemoccupied by a person). For example, activating the light 80 in responseto the visitor ringing the doorbell by pressing the button 136′ may be amore realistic home owner response than activating the light 80 whenmotion is detected (e.g., such as standard PIR motion detection lights).

In some embodiments, the apparatus 100″ may implement the fingerprintsensor 202′ as part of the doorbell button 136′. In some embodiments,the apparatus 100″ may implement a remote control lock box 380 for thehouse key 384. For example, the house key 384 may be securely storedwithin a locked compartment 380 of the apparatus 100″. In one example,the companion application 160 may be configured to remotely unlock thecompartment 380 to enable an authorized user (e.g., authorized by thecompanion application 160) to retrieve the house key 384 and enter thepremises 302 a and/or the secure package deposit 330.

In some embodiments, the wireless communication device 108 may beconfigured to implement a Wi-Fi range extender. For example, when theuser 62 is outside (e.g., in the yard) and beyond the reach of the Wi-Fiof the premises 302 a, the wireless communication device 108 may extendthe home Wi-Fi range. In some embodiments, the apparatus 100″ may beconfigured to implement a siren. In an example, the speaker 352′ may beconfigured as a 6 watt speaker capable of producing an audio level of atleast 95 dB. In some embodiments, the apparatus 100″ may implement adoor knock sensor. For example, the microphone component 358′ may beconfigured to detect audio signals from the visitor 170. The audioprocessing component 356′ may be configured to match the incoming audiosignals captured by the microphone 358′. For example, if the visitor 170decides to knock on the door instead of use the doorbell button 136′ (orspeak instead of knocking or ringing the doorbell), the audio processingcomponent 356′ may detect the sound of the knock (or voice) anddetermine whether or not to provide a notification to the user 62 (e.g.,send a notification using the companion application 160).

In some embodiments, the apparatus 100″ may implement a 4 in 1 cameralens. In an example, the bottom capture device 102 b′ may be implementedusing a 480p or 720 resolution. The lenses 130 a′-130 b′ of the capturedevices 102 a′-102 b′ may be a 160 degree (diagonal) and/or a 180 degreefish eye lens. The apparatus 100″ may implement an IR LED (B&W) (e.g.,the lights 502 a-502 b) for night vision for the top capture device 102a′, and white LED (color) for the bottom capture device 102 b′. In someembodiments, the apparatus 100″ may implement a PIR sensor.

The bottom camera 102 b′ may be integrated as part of the apparatus 100″to remove blind spots (e.g., to capture areas not covered by the fieldof view 114 a-114 b of the front camera 102 a′) and/or to view thepackages 180 and the door 174 at, behind, or beyond the plane 56 of thevertical surface 52 that the apparatus 100″ is mounted to. The apparatus100″ may provide a front, back and bottom (FBB camera) view (e.g., toshow the door 174 behind the apparatus 100″). In some embodiments, theapparatus 100″ may be battery powered. In some embodiments, theapparatus 100″ may be wire-powered (e.g., a wired connection to a powersupply provided for the premises 302 a). The apparatus 100″ mayimplement a door camera system by integrating the FBB security cameraand the wireless doorbell button 136′. In some embodiments, power may bereceived from the adjacent light fixture 210 (e.g., the socket adapter250).

The apparatus 100″ may be configured to be used with the user devices120 a-120 n to display the front, back, and/or bottom views (live orrecorded) simultaneously using the companion application 160. Theapparatus 100″ may integrate a door chime and/or video intercom. Thewall mount bracket 422 may comprise a night vision LED (IR or White) 434and/or the large speaker 134′, which may implement a siren or a highquality music playback device. The user devices 120 a-120 n may beimplemented using customized software for a low cost Android phone as adedicated door chime and video intercom device.

In some embodiments, the apparatus 100″ may connect to a Wi-Fi connectedindoor light bulb 80 to indicate that someone is inside the home whenthe door camera is activated. The fingerprint sensor 202′ may beimplemented as part of the doorbell button 136′. The apparatus 100″ maycomprise the hollow compartment 380 to provide a remote controlled lockbox for the house key 384. The lock box may be integrated with the doorcamera system. The small compartment 380 storing a house key may beunlocked remotely.

Referring to FIG. 20, a diagram illustrating a user device streamingmultiple video streams is shown. An example context 600 of the inventionis shown. In the example context 600, the user device 120 is shown heldby the user 62. In the example shown, the user device 120 may be asmartphone and/or a customized smartphone implementing a video intercom.

The smartphone 120 is shown having the display 150, the speaker 152 andthe microphone 154. The display 150 is shown displaying the companionapplication 160. In the example context 600 shown, the companionapplication 160 may display the video stream 162 a′ (e.g., the videostream VS1), the video stream 162 b′ (e.g., the video stream VS2) and/orthe controls 164 a-164 f.

The video streams 162 a′-162 b′ shown may be captured by the capturedevices 102 a′-102 b′ from the doorbell embodiment of the apparatus100″. In the example shown, the video stream 162 a′ may comprise a viewcaptured by the front-facing capture device 102 a′. For example, in adoorbell embodiment, the apparatus 100″ may be mounted to the verticalsurface 52 at approximately 48 inches from the ground (e.g., a standarddoorbell height). The video stream 162 a′ may capture a view of thevisitor 170 from the height of a doorbell. In the example shown, thefield of view 114 a-114 b for the video stream 162 a′ may capture awaist, torso, chest and face of the visitor 170.

For the doorbell embodiment of the apparatus 100″, the video stream 162b′ may comprise a view captured by the bottom capture device 102 b′. Thebottom capture device 102 b′ may capture the area 118 b below theapparatus 100″. In the example shown, the video stream 162 b′ maycomprise a high angle view of the bottom (e.g., from the waist down) ofthe visitor 170. The video stream 162 b′ may further comprise a view ofthe package 180. For example, the field of view 116 a-116 b for thebottom view video stream 162 b′ may be oriented to capture packages 180left at the premises 302 a. A tracking number 602 is shown on thepackage 180. A portion of a welcome mat 604 is also visible in theexample shown.

The video processor 106 may be configured to scan the tracking number602. For example, the image quality of the capture device 102 b′ may behigh enough to enable the video processor 106 to read various trackingnumbers (e.g., bar codes, numbers, QR codes, etc.). The video processor106 may read and/or decipher the tracking number 602 using opticalcharacter recognition and/or object detection. In some embodiments, thewireless communication device 108 may be configured to send anotification using the companion application 160 to indicate that thepackage 180 with the tracking number 602 read by the video processor 106has been delivered. In some embodiments, the user 62 may use thecompanion application 160 to store particular tracking numbers ofexpected packages, and the video processor 106 may compare the detectedtracking number 602 against the stored tracking numbers.

Referring to FIG. 21, a diagram illustrating a wedge prism in front of acamera lens is shown. A context 620 is shown. The context 620 maycomprise a wedge shaped prism 622 and the lens 130 a″. There are anumber of ways (e.g., prisms and/or mirrors) to combine the areas 118a-118 b of primary interest (e.g., the visitor face and the porch floor)into one image, with image pixels allocated to where the resolution ismost needed.

The wedge shaped prism 622 may be located in front of the camera lens130 a″. The wedge shaped prism 622 may comprise a flat edge 624 and anangled edge 626. The angled edge 626 may be located next to the cameralens 130 a″. In some embodiments, the lens 130 a″ may be closer to thesame size as the wedge shaped prism 622.

In the example shown, the angled edge 626 may be configured to redirectpart(s) of the field of view 114 a-114 b. In the example shown, theangled edge 626 may be angled downwards and the field of view 114 a-114b may be redirected down to the floor (e.g., to view the blind spot ofthe lens 130 a″). In another example, the angled edge 626 may be angledupwards to redirect part(s) of the field of view 114 a-114 b up to theface of the visitor 170. In some embodiments, the wedge shaped prism 622may be rotatable to change the redirected field of view (e.g., changefrom the ground view to the face view).

Referring to FIG. 22, a diagram illustrating a partial wedge prism isshown. A context 640 is shown. The context 640 may comprise a partialwedge prism 622′. The partial wedge prism 622′ may be located in frontof the camera lens 130 a″.

The partial wedge prism 622′ may comprise the flat edge 624′, the anglededge 626′ and/or a cut-out portion 642. In the example shown, thecut-out portion 642 may be approximately a quarter of the size of thepartial wedge prism 622′. The partial wedge prism 622′ may be rotatableto change which portion of the lens 130 a″ that the cut-out portion 642is in front of to aim all or part of the captured image. The locationand/or size of the cut-out portion 642 may be varied according to thedesign criteria of a particular implementation.

The cut-out portion 642 may enable the partial wedge prism 622′ toredirect a portion of the field of view 114 a-114 b (e.g., the portionredirected by the angled edge 626′) and not redirect another portion ofthe field of view 114 a-114 b (e.g., the portion passing through thecut-out portion 642). For example, the partial wedge prism 622′ mayenable the front capture device 102 a′ to capture the area 118 a infront of the apparatus 100 and the area 118 b below apparatus 100. Thevideo processor 106 may combine views from the two angles into oneimage.

Referring to FIG. 23, a diagram illustrating a compound lens is shown. Acontext 660 is shown. The context 660 may comprise a compound lens 662.The compound lens 662 may be a combined prism/lens element configured toreplace the front camera lens 130 a″.

The compound lens 662 may be implemented having multiple lensingsurfaces (e.g., molded) into one combined lens. In the example shown,the compound lens 662 may have a lensing surface 664 and a lensingsurface 666. The lensing surfaces 664-666 may be configured to aim inseveral directions (e.g. up and down). For example, the lensing surface664 may be directed upwards and the lensing surface 666 may be directeddownwards. The number, size or shape of the lensing surfaces 664-666 maybe varied according to the design criteria of a particularimplementation.

In some embodiments, the lensing surfaces 664-666 may smoothlytransition between aiming directions to fill in a complete field of viewwith a lower resolution on the imaging sensor plane in the transitionregions. For example, the lower resolution may be used for an areaexpected to show objects or views that may be less of interest (e.g., awaistline of the visitor 170). The lensing surfaces 664-666 and/or thetransitions between the lensing surfaces 664-666 may cause distortion ofthe captured images. The distortion may be corrected by the videoprocessor 106 in the image processing chain. The video processor 106 maybe configured to combine the two angles captured by the differentlensing surfaces 664 a-666 into one image (e.g., one of the video frames110 a-110 n).

The functions performed by the diagrams of FIGS. 1-23 may be implementedusing one or more of a conventional general purpose processor, digitalcomputer, microprocessor, microcontroller, RISC (reduced instruction setcomputer) processor, CISC (complex instruction set computer) processor,SIMD (single instruction multiple data) processor, signal processor,central processing unit (CPU), arithmetic logic unit (ALU), videodigital signal processor (VDSP) and/or similar computational machines,programmed according to the teachings of the specification, as will beapparent to those skilled in the relevant art(s). Appropriate software,firmware, coding, routines, instructions, opcodes, microcode, and/orprogram modules may readily be prepared by skilled programmers based onthe teachings of the disclosure, as will also be apparent to thoseskilled in the relevant art(s). The software is generally executed froma medium or several media by one or more of the processors of themachine implementation.

The invention may also be implemented by the preparation of ASICs(application specific integrated circuits), Platform ASICs, FPGAs (fieldprogrammable gate arrays), PLDs (programmable logic devices), CPLDs(complex programmable logic devices), sea-of-gates, RFICs (radiofrequency integrated circuits), ASSPs (application specific standardproducts), one or more monolithic integrated circuits, one or more chipsor die arranged as flip-chip modules and/or multi-chip modules or byinterconnecting an appropriate network of conventional componentcircuits, as is described herein, modifications of which will be readilyapparent to those skilled in the art(s).

The invention thus may also include a computer product which may be astorage medium or media and/or a transmission medium or media includinginstructions which may be used to program a machine to perform one ormore processes or methods in accordance with the invention. Execution ofinstructions contained in the computer product by the machine, alongwith operations of surrounding circuitry, may transform input data intoone or more files on the storage medium and/or one or more outputsignals representative of a physical object or substance, such as anaudio and/or visual depiction. The storage medium may include, but isnot limited to, any type of disk including floppy disk, hard drive,magnetic disk, optical disk, CD-ROM, DVD and magneto-optical disks andcircuits such as ROMs (read-only memories), RAMs (random accessmemories), EPROMs (erasable programmable ROMs), EEPROMs (electricallyerasable programmable ROMs), UVPROMs (ultra-violet erasable programmableROMs), Flash memory, magnetic cards, optical cards, and/or any type ofmedia suitable for storing electronic instructions.

The elements of the invention may form part or all of one or moredevices, units, components, systems, machines and/or apparatuses. Thedevices may include, but are not limited to, servers, workstations,storage array controllers, storage systems, personal computers, laptopcomputers, notebook computers, palm computers, cloud servers, personaldigital assistants, portable electronic devices, battery powereddevices, set-top boxes, encoders, decoders, transcoders, compressors,decompressors, pre-processors, post-processors, transmitters, receivers,transceivers, cipher circuits, cellular telephones, digital cameras,positioning and/or navigation systems, medical equipment, heads-updisplays, wireless devices, audio recording, audio storage and/or audioplayback devices, video recording, video storage and/or video playbackdevices, game platforms, peripherals and/or multi-chip modules. Thoseskilled in the relevant art(s) would understand that the elements of theinvention may be implemented in other types of devices to meet thecriteria of a particular application.

The terms “may” and “generally” when used herein in conjunction with“is(are)” and verbs are meant to communicate the intention that thedescription is exemplary and believed to be broad enough to encompassboth the specific examples presented in the disclosure as well asalternative examples that could be derived based on the disclosure. Theterms “may” and “generally” as used herein should not be construed tonecessarily imply the desirability or possibility of omitting acorresponding element.

While the invention has been particularly shown and described withreference to embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made withoutdeparting from the scope of the invention.

The invention claimed is:
 1. A system comprising: a smart doorbellcomprising (i) a first video capture device configured to capture afirst plurality of video frames of a first field of view, (ii) a secondvideo capture device configured to capture a second plurality of videoframes of a second field of view and (iii) a communication deviceconfigured to communicate said first plurality of video frames and saidsecond plurality of video frames; and a device configured to (i) receivesaid first video frames and said second video frames from said smartdoorbell and (ii) execute computer readable instructions to provide anapp interface, wherein (a) said app interface is configured to displaysaid first video frames and said second video frames simultaneously, (b)said smart doorbell is mounted to a vertical surface, (c) said firstfield of view captures an area in front of said smart doorbell, (d) saidsecond field of view captures an area under and behind said smartdoorbell, (e) said second field of view comprises a blind spot of saidfirst field of view and (f) said second field of view includes saidvertical surface below a level of said smart doorbell.
 2. The systemaccording to claim 1, wherein said second plurality of video frames areconfigured to provide video of at least one of (i) a door below saidsmart doorbell, (ii) packages left under said smart doorbell or (iii)both said door and said packages.
 3. The system according to claim 1,wherein (i) said first video capture device and said second videocapture device each implement a wide angle lens and (ii) said wide anglelens enables said second field of view to capture an area behind a planecorresponding to said vertical surface to which said smart doorbell ismounted.
 4. The system according to claim 1, wherein said device isimplemented as a customized smartphone configured to (i) enable a directWi-Fi connection to said smart doorbell and (ii) interact with saidsmart doorbell using said app interface.
 5. The system according toclaim 1, wherein (i) said smart doorbell comprises a video processor,(ii) said video processor is configured to (a) generate both said firstplurality of video frames and said second plurality of video frames and(b) reserve less resources to generate said second plurality of videoframes than said first plurality of video frames and (iii) said secondplurality of video frames has a lower video quality than said firstplurality of video frames.
 6. The system according to claim 1, whereinsaid smart doorbell is configured to implement at least one of anintercom, a door chime, a siren or a combination of said intercom, saiddoor chime and said siren.
 7. The system according to claim 1, whereinsaid smart doorbell further comprises a battery to provide power forcomponents implemented by said smart doorbell.
 8. The system accordingto claim 1, wherein said smart doorbell is configured to receive powerfrom a doorbell power supply.
 9. The system according to claim 1,wherein (i) said smart doorbell is configured to receive power from alight fixture and (ii) said power from said light fixture is receivedvia a USB connection to a light bulb socket adapter comprising a USBport.
 10. The system according to claim 1, wherein said smart doorbellis further configured to implement a wireless doorbell.
 11. The systemaccording to claim 1, wherein (i) said smart doorbell further comprises(a) a speaker configured to present audio captured by said device and(b) a microphone configured to capture visitor audio for playback bysaid device and (ii) said smart doorbell is adapted to implement a videointercom with said device by implementing a wireless connection to saiddevice to (a) receive said audio captured by said device and (b) presentsaid first plurality of video frames to a video display of said device.12. The system according to claim 1, wherein said first video pluralityof video frames and said second plurality of video frames are uploadedto a server computer to (i) generate a stored recording and (ii) providea live view.
 13. The system according to claim 1, wherein said smartdoorbell (i) further comprises a button, said button (a) is configuredto activate a doorbell when pressed and (b) comprises a fingerprintsensor, and (ii) is configured to perform an operation in response to afingerprint detected by said fingerprint sensor.
 14. The systemaccording to claim 1, wherein (a) said smart doorbell is furtherconfigured to (i) detect a visitor and (ii) generate a notificationsignal in response to said visitor and (b) said notification signal isconfigured to enable an indoor Wi-Fi light bulb.
 15. The systemaccording to claim 1, wherein (i) said smart doorbell is configured toattach to a wall mount bracket and (ii) said wall mount bracketcomprises at least one of (a) a speaker configured to produce a soundlevel over 95 dB, (b) a lighting element to improve night vision or (c)a wireless communication device.
 16. The system according to claim 1,wherein said smart doorbell further comprises a lockable hollowcompartment configured to (i) store a key and (ii) be remotely unlockedby said device.
 17. The system according to claim 1, wherein said secondfield of view is adjustable by tilting said second video capture device.18. The system according to claim 1, wherein said first video capturedevice is configured to capture said first field of view and said secondfield of view by using at least one of (a) a mirror and (b) a prism. 19.The system according to claim 1, wherein (i) said first field of viewand said second field of view are configured to partially overlap eachother to provide an overlapping field of view, (ii) said smart doorbellis further configured to (a) triangulate a distance to an object in saidoverlapping field of view and (b) send information about characteristicsof said object to said device and (iii) said characteristics of saidobject comprise a direction of movement and said distance.
 20. Thesystem according to claim 19, wherein said distance triangulated usingsaid overlapping field of view is used to discriminate between objectsof interest and unimportant objects.